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FOREWORD 

• K ' -v' ' : • ^ 

The Compute r-Based Instructional Systems Team of the Army Research In- 
stitute for the Behavioral and SocTal Sciences (ARI) performs research and 
development in areas of ins fractional technology that apply to military 
training. A special research focus is the use of computer-based systems, 
which can provide highly individualized training and can therefore improve 
training effectiveness as well as reduce training costs and time* 

This report describes the results of the first year of a» 3-year effort 
to develop and evaluate a new Adaptive Computerized Training Systert (ACTS). 
The ACTS combines the principles of Artificial Intelligence, decision theory, 
and adaptive Computer-Assisted Instruction to provide improved maintenance^ 
training. 'In order to accomplish this research, ARTs resources were aug- 
mented by contract with Perceptronics, Inc., an organizatiol* selected as 
having unique capabilities for research and de>telop'ment in this area. , . 

The research effort is responsive to the requirements of RDT&E Project 
2Q762722A764', Training and Education, as describee! in the ARI FY 79 Person- 
nel Performance and Training Program. 
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ADAPTIVE DECISION AIDING IN COMPUTER- ASSISTED INSTRUCTION: ADAPTIVE 
.COMPUTERIZED TRAINING SYSTEM (ACTS) " 



BRIEF 



Requirement: , 

* * 

4 The Adaptive Computerized Training System (ACTS) is being developed to, 
provide general Uable diagnostic skH+s - to maintenance trainees. * 

Current Army maintenance training is largely equipment-specific. The* 
student first learns the step-by-step procedures fpr locating a malfuncti^p 
in a specific item of equipment, then practices and is tested on the equip- 
ment itse lf. S kill thus learned does not transfer readily to other equip- 
ments Al so \, eq'ufjjj^nt that could b^ ased operationally is requyfed for" 
training, instructors must spend time inserting malfunctions into equipment 
instead of teaching, and students spend time assembling and disassembling 
equipment that Should be spent experiencing a variety of faults. 



, ACTS Training: v - N - 

Jhe ACTS, applies principles of artificial intelligence, decision* theory, 
and adaptive computer-assisted instruction to Army maintenance training. The 
student's ta*k in 'ACTS training is to troubleshoot an item of equipment by 
making ^various test- measurements and replacing the malfunctioning part. ACTS 
simulates the electrbniomalfunction; with no actual equipment required. It 
also uses artificial intelligence techniques to develop mathematical models 
of both the student and the expert performer. These # models can serve as a 
basis for evaluating student performance. Previous research has shown the 
feasibility of the. ACTS approach. This effort. focused qn improving ACTS soft 
.ware and courseware, and on initiating evaluation of the improved system. 

9 

The new software developed permits simultaneous use of the ACTS by mul- 
tiple students, simul taneQJUS use of different items of equipment, and simple 
fied techniques .for modeling new items of equipment. Revised procedures for 
modeling 'student and expert performance permit the presentation to the stu- 
dent of feedback which 'is based on a comparison of student airo* expert models. 
A plan for the installation of the ACTS, at the U.S.. Army Signal Center at 
Fort Gordon, Ga., was developed, which will permit the evaluation of the 
ACTS in an operational training setting. Finally, a pilot experiment was 
performed to dp-bug ACTS courseware, software^ and experimental procedures. 

. ' ? 

Utilization: . 

ACTS research and, development will continue for an additional 2 years, 
culminating in a cost and training effectiveness evaluation of the system 
in an'ongoing course of instruction at' the U.S. Army Signal Center and Fort 
Gordon*. If successful, it is expected that the system will be implemented 
in Army schools providing maintenance training. 
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1 . * OVERVIEW 



* / 



1.1 Objectives of Phase I 

This report describes the results of the first year's effort of a three- 
year program to develop and evaluate' a new Adaptive Computerized Training 
System (ACTS). The overall effort' combines the principles, of artificial • 
intelligence, decision theory, and adaptive computer-assisted instruction 
so as to result in improved training techniques for usewith Army recruits 
in the learning of electronic maintenance troubleshooting procedures? 
In'particular, ACTS is. intended to focus on enhancing the acquisition 6f 
decision-making skills which underlie successful electronic troubleshooting 
performance." An important aspect. of ACTS is the emphasis on realistic 
simulation of maintenance problems during training so as ts increase the 
- -potential for transfer of training to field situations, ACTS' design 
'-incorporates a'n adaptive computer prog-ram! (1) to track students' diag- t 
nostic and decision value structures for comparison to that of an expert, 
(2) to develop appropriate individualized feedback, and (3) to structure 



subsequent learning experiences. 
» • 

Major objectives of Year 1 were: 



/ 



(1) To develop new software which provides for simultaneous • 
use of ACTS by multiple students, which permits simultaneous 
us"e of different circuits, which provides for interchangeable- 
circuit modules, and which is compatible with equipment and 
computer systems-available at the Fort Gordon Army Signal * 
School . 



(2)^0 develop new courseware which includes a more powerful 
decision -model and amproved "instructional text, and which 
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I provides for utility 'driven performance feedback and 
variable problem presentation modes. 

(3) To- develop a plan for ACTS transfer to a military training 

* ' environments namely the Army Signal School a.t fort Gordon, 

• Georgia, < • u 

A ^ r 

'(4) To' conduct experimental work in order to evaluate the 

i * 

^ . . effectiveness' of the, new ACTS. 

1.2 ' Approach ' \ 

r s 

* < * 

Computernassisted instruction continues to represents promising avenue 
both for research 6n the ba^sic instructional processes and for the develc 
ment and integration of artificial intelligence techniques t6 enhance 
individualized instructional' processes in a nUmber' of areas, including 
training of decisionmaking and problem-solving capabilities. ACTS is a 
particularly important example of such training technology. Utilizing 
adaptive, compjuter-based techniques, the ACTS^permits Individualized 
training in an elect-ronic maintenance environment* • The system has been 
successfully implemented in the labbratory^and subjected to limited 
testing. * * m 7 ' . 

A major portion of the fiVst year's effort consisted of expanding the, 
system tp accommodate! multiple tasks and multiple students, by develop- 
ing multipfe circuit' ca^ility and improving the ACTS 1 software orgarr?- 
zation. As a result/of previous experimental findings, tfie d utility jnodel 
of the origin^ ACTS were 'replaced by more efficient multi-attribute 
. utility (MAU) models and the ACTS ^as supplemented w-ith production rules. 
In addition, the*exisfing software v<as modified and expanded to .provide 
for simultaneous use of multiple students and multiple circuits, as well 

■ ■ ^ A . . ■ 



as for interchangeable circuit, modules. Evaluation of the ACTS is being 
documented, and a preliminary study was conducted to evaluate the train- 
ing effectiveness* of. the ACTS -and the general izabiltty of the results 
stained with the ACTS. The^softWan? i£ compatible yith equipment in 
use at the* Fort Gordon* Army Sigl^l School. 

* 4 

1.3 , Accomftl-ishments ^ 

The accomplishments of the first year tasks focus on four areas. The 
following is a su(fonary of the work accomplished in each fcrea. # , 

1.3.1 -Development of New Software . § 

- ; . . • , f ■ i 

New ACTS Design . A new version of ther ACTS has been designed, coded and 

tested. The n<2w ACTS contains the fol lowing main features.^ * . x 

\ 

MultipleSturients . The new design, allows* two or more students to use 
the system si^ultaneQusly. The students can* run on fully independent 
instructional sequences, subject only to memory constraints. Addition- * 
ally, - an experimenter Gan communicate with the- ACTS during system execu- 
tion via the- teletype I/O channel. N 

Multiple Circuits , lach set 'of ci rcui t modules is circuit specifier 
Thctt is, any circuit is ful ^represented by the circuit simulation 
model, together with* the instructional text module for that circuit. 
Consequently, any student using thaJlCIS, may interact with' it indepen- 
dently of whatever circuit has been modeled, subject only to secondary 
storage limitations. New circuits can be modeled by creating a circuit 
simulation model and instructional text module specific to that circuit, 
.using a fixed structure. A. s^arate document (Perceptronics 1 Report t 
PDCMDM- 1076-79- 7, J979) describes the necessary steps for modeling new 
circuits: /' ' . ' 



' Parameterized Circuit Model . .Each circuit has * simulation model assoc- 
ciated with it,' consisting of an overl-ay jwi^h a fixed structure. Creating 
a new circuit model involves filling in the, specific parameter values,. 
such as. measurement outcomes and the niSmter of faults for the new circuit. 
This is done; by utilizing an existing circuit -model ('as a guitie. The 
process requires only that'the new circuit be at a comparable' level af- 
,/ complexity to those already Modeled. Since all circuit models haye ' « 
standardized structure, and parameters, the development of new. circuits' 
for the ACTS is relatively Simple.^' . 



Variable Mode Problem Presentation . Problems are characterized in -terms x 
of their 'difficGlty level'! Since it is assumed that the sequencing/ of 
problems may ha\>e* an effect on perfo'rmance, there are two modes in which 
the problem's are presented to the students. J-j the f irst mode,' the 
problems are presented randomly, regardless of their difficulty level; 
in the second mode; the presentation sequencers fixed, beginning with 
all* problems having .simple- to-locate faults, continuing in a graduated 
manner with* problems haying intermediate levels of difficulty, and end- 
ing with problems h&tffng faults .which are very difficult to locate- ■ - * 

1.3.2* Multi-Attribute Utility (MAU) Decision Model > A muUi.-attribute 
utility -(MAU) decision model* exhibitinsuefficient y decision-making be- * 
hJPfor for troubleshooting electronic circuits, has been developed.. This 
multi -attribute model is superipr to earlier, modeler because /it* can capture 
circuit troubleshooting behavior indejSendent* of circuit type, thus provid- 
ing a more generalized behavioral representation than waa the case in the,, 
earlier version of the ACTS'; The attributes used in the present syjstem 
include cost, and information gain measures. Costis an estimate of the 
time .and material*, required to take a 1 particular measurement or replace a 
module, ^and varies depending on the action involved. Fault information . 
gain refers to the proportion of faults that are expected to" be eliminated 
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by a parti cut ar measurement or niodule replacement. ' Fault information - gain 
' is_ an impoYtant. attribute*, in', that some measurements or" rjp^aoirterits are -. 
m6re'*efficient than others in, reducing the) set of all possible fau-Hs. • 
Commercial information £#1n indicates the degree- to^which the remaining 
^possible faults will be! "clustered" wUtn a commercial circuit components, 
/ given a particular measurement. ^{Since^it.is. easffer t'o troirbleshoot 
circuit when all req^iaing possible faults are clustered in a couple of t 
circuit components' rather than scattered throughout; a measurement^ wlrich 
> will permit greater proportional circuit modiUeJ^oVation , is more 
efficient than one not having, this c-apabtli^. ) The software it designed 
'jit such a way tha* new attributes can i>e added»/or any of the existing ' 
attributes al teredy if the need arises. , 



•module .designer performs a conventional task analysis orwt 
making troubleshooting skills required for a given'circuit 



l.Z.J Instructional Text . To develop instructional text, thecircuit 

deci^ion- 
The result 

- is, a sequence of skiVl-based objectives ChaTNljusi, be translated into 
teaching units .* Th6se i^ts generally "consist of text material, an 
optional question-answer^ session, and a multiple-choice test, and, are 
designed to Improve the "circuit knowledge of tire student. The student 
is guided through the,se units until the required level of circuit know- 
ledge necessary to begi rr troubleshooting is obtained. * * 




t in the 
terial 



Instructional text is also embedded in the t 
form of 'preliminary lecture material, fe 
provided by means of a "Help" option. 



Utility Driven Performance Feedback . During the terminal troubleshooting 
feedback _is '-derived from t h e M MUno del we ights- whil e t h e ■ 




Student is being trained. Information concerning the degree of^conver- 
gence, proximity to the_e#pprt model , and relative weighting difficulties 
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can be assessed frorar the student and expert models! Th.is information, 
§ in turft, is used to encourage consistency, to teach the student to mimic 
the expert, and to adjust the^significance with which displayed attribute 
-information is viewed. ( > 



1.3.4 " ACTS Transfer to Military Training Equipment . A plan for the 
installation of the ACTS on an operationaJ Army computer-based training* - 
System was developed, and. is documented in Perceptro&4cs, PDIP*1076-7§-6. 
The document describes the plan for installation of the ACTS in the Cpm- 
puterized Training System at Fort Gordon, Georgia. » It includes a study- 
of - the^cu^mjuxon^lgur ati oil, and ogeraiion of__tha_ loindjig-jSy stents iden- 
tifies expected 'problem aneas, examines transfer alternatives, and pre- 
sents a complete program plan to accomplish tfie ACTS transfer. V : / 

In addition, a site visit tfo Fort Gordon . was, made to determine the scope 
of the existing training progritw and to perform a needs analysis, based 
on ttje entry level. of tfie students end the instructional objectives of* 
the U.S. Army, Signal School at Fort Gordon. 

1.3.5 9 Experimental Study . A pilot experiment was performed, which 
served two major P^fe^ : the' first was to fine tune the ACTS and the - 
methodology 7or pVrfl^^ig the large-scale study desig/ied for the follow- 
ing year and the second purpose was to obtain preliminary data to assess 1 
the training value of the ACTS. . 

As a. result of this study, several improvements were made to the software, 
including the design of 3 new print-out routine for obtaining performance 
measures. Despite some inadequacies in the. system, the data obtained from 
three-college students suggest that the ACTS does indeed train the higher- 
order decision-making skills necessary to troubleshoot electronic circuits. 
Details of thef'experi mental method, and the results obtained, are described 
in Chapter v d, , , - 4 
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1.3/6 Directions- for the Future , While initial results are particularly 
-promising-, the ACTS still remains to be tested in the fulVblown opera- 
tional training environment- It, is anticipated that such .a study will 
be undertaken in the near future, which will include, among other things-, J 
an assessment of:* the transfer .of skills which occurs with the trouble- 
shooting of real, rather than simulated, -equipment and the long-ternr re- 
©- ' tention of skills. It is hoped that field stud.ies will bear out our 
• ' . conviction that ACTS can make a significant practical contribution to, 
the training of electronics maintenance personnel. It should not 
overlooked that th^basic -approach. outlined above may. have implications'* 
. fop improving the^relity of human decision performance on related taslcs, 
although the applicability of ACTS outside the electronics maintenance 
- • training area remains to be explored., 
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Z) THEiaJAPTIVE COMPUTERIZED TRAINING SYSTEM * 



2.1 . Overview' 



The Adapti-ve Computerized Training System (ACTS^ focuses on Improving and 
sharpening higher-order cognitive skills in electronics troubleshooting. 
The application of decision models to training is reviewed prior to pre-, 
sentation of the features "of -the ACTS. ; . 



Although mairvtenartce task£ re>y heavily, on a technician's knowledge and 
^trarrrrrng re^ardljig the maintained^yst^$^-*i^^ 

marily as decision tasks. If^the technician'possesses sufficient kn$w- 
ledge of system* parts and functions,, he applies it by making a series of 
decisions about which symptoms to look for, whether to repair or replace 
a malfunctioning pa'rt.'and so on. ACTS is used in electronics maintenance 
training to address the quality of siich decisions and the process of gen- 
erating and choosing from among alternatives, rather than for the learning 
of specific procedural sequences. / 

ACTS incorporates an adaptive computer program which learns the student's 
diagnosTTCand' decision value'.structure, compares it to that of an ex- , 
pert, and adapts the'instructiqpal sequence *so as to eliminate. discrepan- 
cies. An expected utility (EU) or a multi -attribute, utility (MAU) model" 
is the basts of thej)tudent and instructor models which, together with' 
a task: simulator, form the core of ACTS. Earlier versions of the system 
used an expected values model (Freedy and Crooks, 1975; Crooks\ Kuppin ~ 
and Freedy, 1971). The student model is dynamically' adjusted using a 
trainable network technique Q.f -.pattern classifi6ation. Phe training con-« 
tent (instructions) and problem presentation sequence are generate d with — 
heuristic, algorithms. ACTS'is implemented on an Interdata Model 70 mini- 
computer and u$e$ interactive graphics terminals for man/machine communica 
tion. . ' > 



The present training system focuses on electronic troubleshooting, the 
student's task m to troubleshobt a complex circuit J>y making Various 
test measurements, replacing the malfunctioning part, and making final • ' 
verification~measuTeiiients. The model oT« the student evaluates- the stii-, - 

dent 1 ? selection of measurements and replacement of circuit modules. •* % 

* « * * 

Troubleshooting provides an excellent application for the. ACTS methodology 
because it*\is heavily dependent on- judgment and probabilistic inference* 
In addition, troubleshooting is of great practical importance in numerous 
commercial and military systems, ahd it lends itself* to economical imple- 
mentation for training purposes. ^ 



Work to date has pn^luced an operational system which demonstrates the 
feasibility of applying artificial intelligence techniques to computer- 
assisted instruction in a'minicomputer-based training system. Expeni-^ , 
mental evaluations of ACTS have demonstrated that the adaptive decision 
model accurately learns the utilities of an - expert technician -and that 
students can effectively use the simulated troubleshooting task. 

Additionally, instructions based on utilities can furthef 1 improve the 
decision performance of students; howeyer, feedback .0^ optimum choices 
immediately following the student's choice also seems necessary.- 

2.2 Background: CA1 and Decision Making 

2.2.1 Individualized Instruction . A central theme in the fietd of x 
^educational technology is the creation of methods which allow indiv.iduaV 
ized instruction. Training specialist? and educational theorists recog- 
nize the importance of focusing on the individual studentjf significant 
advctncej in the efficiency and effectiveness of instruction are to be 
made (Crawford and Ragsdale, 1969; Glaser, 1965), Bloom (-1968) has 
adv'ocated^ the concept of mastery learning, in which instruction^ de- 



signed and managed so that all, students reach a given level of achieve- 
merit, albeit at different rates.* ' ) 

The principles now included under thp rubric 6f programmed instruction % 
(PI) 4 which grew out of pioneering work by Pressdy, Skinner, and others, 
have facilitated the practical implementation of mastery ^earning tech- ? 
niques. 'Such principles ,* also claimed as advantages of PI, include: 
student-paced progression, irritfedi ate knowledge-of-results, ^individualized 
instructional* sequencing, use of explicit performance objectives, diag- 
nostic assessment, and t<jie* division of instruction into small discrete steps. 
^STgrprnrcTpT^^ for tfre niium-p-tlcny of xprogT^rmerf text- * 

books, teacning fifactiines, and the early CAI systems seen'in the 1960's. 

2/2.2 Adaptiye InstfuctiW 'It has-been recogftt'zed for more than a 
decade that true individualized instruct^ must include some forth of 
adaptation to the individual student. (SmaJHwood, 1962). However , .while % 
most researchers recognize the^need to adapt ihstruction ttJ individual 
differences, adaptation is usually made on the basis of response history. 
That iss the great? majority of adaptive programs are made adaptive by 
the logic ^r^nching structure of the programs. 

Y * . * 

Centra! to the problem of< adaptive CAI. is the utilization of suitable 
criteria for optimizing learning effectiveness and the construction of . 
decision rules for selecting. instructional options. The development of 
adequate decision rules is very difficult in^conventional adaptive CAI 
systems because a.student's knowledge and .ski 11 level appears to be 
structured and fallible, when viewed 1 r>* the context ^of jCAI . 

— Sophi.st,ifrated optimiza fevefl- t e chniqu e s' fo ^ m a ^im - i zing-l ea rn i ng eff e c tive- 

ness have been used in several very elegant and highly adaptive CAI pro- 
grams (Atkinson, 1972; Smallwood, 1971). 4 However, these techniques have 
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only been used for simple learning situations, which 'usually involve lower- 
order cognitive ski/lls such as memorizing lists of vocabulary words. This 
is because the optimization methods (developed from control theory) require 
a precisely ,stated' learning model which predicts student response to al- 
ternate instructional options. As skills become mdre complex, it is less 
likely that simple mathematical learning models can be found. 



<A promising approach to adaptive CAI is the application of -Artificial 
Intelligence'-, CAI) techniques.^ AI techniques and theory, traditionally , 
have been concerned with the intellectually demanding tasks of problem 
--saving ^nd^oa4^pected-deei-& ion-making, - -These—techniques = are.=uniqualyL 
suitable for applications where unstructured environments are involved 
(NHsson, 1965-; Slagle, 1971). Natural language understanding and the 
heuristic programming approach to pattern recognition have been used in 
QAI systems which are based on information structure representations of 
the s.ubject matter (Carbonell, 1970; Hartley and Sleeman, 1973; 'Hoffman 
and Blount, 1974; 3rown,. Burton, and Bells, 1974). These systems utilize 
network analysis of .the s^ruttures to generate instructional sequences, 
thus, the terni "generative CAI." 



>£iVi< 



Techniques o % f adaptive pattern classification can'also be used to provide 
individualized instruction. Given a model of the st;udent\s behavior., the 
pattern classif.ier adaptively adjusts parameters of the model until the 
' model' accuracy predicts the, student's performance. The model parameters 
then provide the basis for generating instructions and feedback. For the 
presentvdeci^ion training System, the parameters of an 'adaptive decision 
model are used as the basis' for training the student in a. decision task. 



\ 4 



? ? ? Adaptive Decision Modeling. Adaptive models of decision making 



- attempt. to learn the decision process of the human operators by (1) succes- 
sive observation of their act'ions, and (2) establishing an interim relation- 
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ship between the input data set and the output decisions \ the" m'odel ) . 
Learning in this context refers to a ^rainipg process for adjusting 

4 * 

model parameters according to a criterion functioh. The object is to 

improve model- performance as a function of experience or to match the 
model characteristics to that of the operator. » 

1 ' 1*' 

1 

There are two areas of research which attempt to establish useful adap- 
tive decision models. The, first, derived from behavioral decision re- 
search, is termed bootstrapping (Dawes, 1970; Goldberg, 1970). ?his 
procedure uses a statistical regression process to fib the parameters of 
/the de^sion-modeJ^^he^eci-sjon maker! S-P££vaGUS^dgments. _Jiow£Y£ii*L 
the bootstrapping technique is applied off-line to decisions which have 

been observed earlier. 

/ 

A second approach to adaptive decision modeling involves trainaB^e deci- 
si on and classification networks. This technique is used as the basis 
of the ACTS since ^it provides the capability to adjust model parameWs 
on-line and to change model performance accordingly. Two types of models, 
have been used in the ACTS, an Expected Utility Model (EU) and a~Multi- 
Attribute Utility Model (MAO). The technique centers aroynd adjustment 
of the EU or MAU model decision making. The decision network follows th 
decisions of the decision maker and adjusts its parameter^ to make it be- 
have like the operator. 

r \ 

/ 

"The dynamic value estimation technique, developed by Perceptroriics irr the 
context of a decision (aiding task (Crooks, Kuppin and Freedy, 1977), is 
based on the principle-'of a trainable multi -category, pattern classifier. 
The value estimator observes^the operator's choices among R possible 
decision options available to him, viewing his decision makin g as a pro- 
cess of classifying patterns of. event probabilities. The value estimator 
then attempts to classify the event probability patterns by means of*an 
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expected utility evaluation, or discriminant functions. These classi- 
fications are compared vrith the operator's decisions and an- adaptive 
error-correction training algorithm is used to adjust pattern weights, 
which^ correspond to utilities, whenever the classifications are^incdrrect. 
Thus^, the utility estimator "tracfcs" the-* operators decision making and 
"learns" his values, 

t.ZA Decision Models in Maintenance Training . A maintenance techm- 
cian makes a number of decisions while servicing the systems under his 
responsibility. He must decide whether the system is^perfopiing within 

■tble , .l imits „ MhaJLjsYmpli^^ 
to gather in troubleshooting, what test equipment to use, and so on. 
For these -types of decisions/ the technician must be trained to know . 
tfte alternatives avaflable to him, to estimate the. odds on the outcomes 
of thesL| ajternatives, and to assign a value to each alternative. For . 
example, in auto maintenance, tile mechanic is trained to adjust the.,dis- 
trib.utor* with a '"feeder" guage or a dwell tachometer/ He learns how* 
accurately he is able to set the dwell angle with either instrument. 
The decision to choose one instrument or the other -is influenced not 
only by the odds of setting the angle correctly /but also by the tech- 
nician's stakes .of values for each alternative. The feeler gauge may 
be preferred if it i^s right next to the mechanic in his tool box. 

Decision trainingin maintenance should thus focus the stydent's attention 
on (1) .listing the alternates that he must consider, (2) estimating the 
odds of the various outcomes, and (3) evaluating the desirability of the 
outcomes. The adaptive MAU decision model irythe ACfS provides a method, 
for instructing the student in these activities. The student is not** + 
tryfned to make a specific sequ e nced decisions. Rather, the parameters 
of the 'MAU -model are tl^ed as a standard reference to generate ,instruttion§ 
about how to evaluate the decision alternatives. In the ACTS, adaptive 
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sequential decision training is implemented within the context' of elec- 



tronic circuit troubleshooting. -The student's task is to find a circuit 
*fault by making continued measurements until -the device is repaired, 
However, the same principles can be applied tQ many other- types of 
decision-making tasks. 

The training given in the circuit fault diagnosis and repair task is ■ 
based on the assumption that the stad^nt has a good basic background 
in electronics but -that his experience with troubleshooting is limited ^ 
This might be the case with a student who has recently completed a<ivanced 



military electronic? training but has not yet performed troubleshooting 
tasks in his first permanent duty assignment. This* ski 11 level can be 
assessed either in terms of previous training received or in terms of 
performance on an entering test of electronics and troubleshooting know- 
ledge. It -is assumed that the prerequisite Jaws of electricity, circuit 
component behavior, circuit sub-systems, circuit diagrams, use of test 
equipment, and 'the like, hctve already been learned. 

2.3 ' ACtS System Description - 

The ACTS is an interactive computer program that models and simulates the 
four furtctiooal units of training: (1) the task being, trained, (2) the- 
student, (3), the instructor, and (4) the instructional logic. The organ r 
ijfatiofi 43f these four units iri .AGTS is illustrated in Figure 2-1. 

1 * 

2.3.1 Task Simulator . In ACTS* the student's decision task involves 
troubleshooting an electronic device. The tfroybles hooting task centers 
on a-model of an electronic circuit' in which faults can' be simulated. 
Tne circuits currently used are a modular version of the Heathkit IP-28 
regulated power supply and the U.S.^Army A9GO0 power supply. The simu- 
lated circuits have 10 and 11 functional modules, respectively, w)iich c^ri 



to 

2-7 



. 22 



PERFORMANCE 
EYALUATI&N 



-f 



, "I 



INTERACTIVE 

-UBTRUCIUWS. 



INSTRUCTIONAL _LOG£C 



-W STUDENT 



STUDENT 
DECISION 
MODEL 



INSTRUCTOR 
DECISION 
MODEL 




TASK 
SIMULATOR 



J 



3 



FIGURE 2-1, - . • {. 
ACTS FUNCTIONAL ORGANIZATION 



2-8 



23 



be replaced and 32 and 23 measurements, respective^/, which can be'use^ 
to isolate faults: The oper/tipn of each* power supply Is simulated by 
computer. program,- using a table-driven simulation of the fault.syS- 
tem. TJie program simulates the results of checking symptoms , taking 
measurements, and replacing modules. . - # 

t Training in the present system occurs jwith certain restrictions on tide 
e^ent of circuit simulation. Tbe^tudent interacts with a terminal 
which contains a display of tjje simulated circuit;, thus he* cannot make^ 
such troubleshooting observations as smelling faulty capacitors, looking - 
far-burned- res f s tors y-o^ tou ching overheat ed sem4^0ftductors^ In addi* 
tion, the measurement results are presented in a semi-interpreted form 
(high, normal, low), rather than as absolute readings, (e.g. , 3.6% volts, \ 
1.25mA), so that the student need not refer to a table^f normal circuit 
levels. Although th6se modifications involve an abstraction of the 
troubleshooting task, it is assumed tjhat they do not affect the critical 
decision making aspects, qf the troubleshooting task. " * 

The circuit simulation was designed to meet several objectives. In 
addition to providing an environment for observing troubleshooting* 
behavipr, the simulator gives the results of the* student 1 s choice of 
aliernatives by delaying the resu^is^of measurements. Finally; the ~ 
circuit. model Is designed to simulatenhe essential characteristic?, of 
decision-making under uncertainty.- Thus, the outcomes of the measure- 
merfts are probabilistic, refletting the fac,t that, in practice, fault 
locations are uncertain for the troubleshooter. 

j 

2*^.2 Stuflent Decfsion Model . The student, decision model is a mathe- 
matical utecHim m" h *1 in thf> ArT ^ to mnf1p1 thft decision behavior 



of the trainee and his instructor. The student decision mode.l provides 
a method of describing or defining the student's behavior. The ACTS 
then uses the model to inf^r the current state of the student's knowledge. 

2-9 .- ^ 



The decision model not only describes the, initial* state' of the student's 
knowledge byt it also tracks changes in the student's performance, adapt- 
ing themodel parameters to des6ri^e-the students improvements, and 

errors! From* this model of the student's behavior, the ACTS' gives in- *• 

*• • • • " 

structidns to improve the student's decision marking. . • # • 

A multi-attribute utility (MAU) decision model is used to represent the < 
student. The MAU* model .is both a descriptive and normative model of 
decision making which assumes that a "rational" decision maker selects 
the alternativejyith the greatest expected yaluS.' The multi-attribute 
UTTTTty model ts an improvement over the expectSdTrttll'tj fEU)tnodel — . 
that was the basis of decision models, in the original* system. This 
approach was selected "on the basis of earlier experimental work dW 
with the ACTS system. The MAU model fias been applied to related areas 
in adaptive decision modeling and 'information acquisition. tasks (Ste^b, 
Chen, and Freedy, 1977; Samet, Welt^jian, ^nd Davis, 1977) and was found 
to be more effective than the EU approach used in the originaj ACT*system. 

The improved MAU model has several ach$ntages over the* Ell« model: fewer' 
utilities are needed to model a particular circuit troubleshooting 
strategy; it converges faster, is mor^ general , and is easily transfer-^ 
able across different circuits. It is also easier to establish a new 
model for different circuits and thus, it is mose compatible with v the 

4 o 

operational training environment. „ 

unique aspect of the multi-attribute -fliodel is that^uti'li ties' are 
assigned to general attributes of troubleshooting actions rather than 
ti specific outcomes only. According to^the model, decision making 

within the cont e xt of electronic troubl e shooting invjj^ves thre e basic 

factors: (1) Fault information gain, (2) commercial information gain, 
and (3) cost. The expected value of an action i$ then the sum of these. 



if* 

.2-10 



-J 



" ' ■ TV .■ . <. ' J? 

factors weighted by 'specHfi ^utilities . The attributes* and model are 
presented below; *• 4 



Where 



Fault InformationM-fain: 

Commercial Ircfonnation Gain: 

• A. 2 - J Pi j (M-Mi j)/M 
Cost; 

• A.- = c. * ' 

— - r3 ^ — — 

MAUr 

• ' mau. =. I y iK . 



Pi j = Probability that the j'th-outcome will occur if ttfe>1'th 
, alternative is chosen, , * * 

F> = Current number of possible faults. ■ - 

M = Current number of possible faulty modules.* - 
Fij = JYumbefr of possible, faults given current possible faults 

.and the j'fch outcome for action i/ 
. Mi j = Number of |oss ( iblfe faulty modules given curren^po§sible. 

faultsj^d the^j 1 th oytcotne far actfon i! 
C. = Cost of i 'th action/ 1 * *- . 

'A.„. s k'th attribute for actions". ' * * • • 

1 N f .... t 

»y K = Utility for kith attribute. • . ' * 

MAIL s Expected* utility of action-i/ . 



£iven the available alternatives, attribute levels and utilities* the 
optimum choice is determined according to the maximum expected utility 



principle -by calculating*. the expected .utility for each possible alterna- 
tive and then selecting that alternative with the* greatest MAIL 

ACTS uses the MAU model no^ only as the description of the ^tu'jdent' s 
decision making but also as the basis for estimating change^' in h.is 
knowledge as inferred from his decision behavior. A technique c-f arti- 
ficial intelligence, known as. the learning network approach to pattern 
classification* is^sed ,to estimate the' student 1 s* utilities in the EU 
model" (Crooks, Kuppin and Frefedy, 1977). The utility estimator observes 
the .student 1 s choixes among the possibfe-dacision alternatives, viewing 
his decisionmaking as a process of classifying patterns of event pro- - 
# babi 1 i ties. The utility estimator-then attempts to classify the ev.ent 
probability patterns by means of £ multi-attribute^discriminant functiortf, 
Th£se classifications are cornered with the students choices and an 
adaptive error-correction training algorithm is used to adjust pattern 
weights, which correspond tp utilities, wnen&ver the classifications are 
incorrect* Thtsutility estimator operates concurrently in real* time 
as the student performs^ troubleshooting operations; thus, the MAU model 

continuously tracks the student's decision performance as it changes 

' J 

during the course of training. . , 
» 

2.3.3 Instructor Decision Model » The second decision mode? in ACTS 
is an MAU model of an expert decision maker's performance. This model 
is used (1)' as a standard agairfst which the utilities of ^ th^student 
model are compared, and (2) a? a source o<help in directing ^the student's 
activities and in suggesting alternatives. The instructor model has the 
same mathematical f^rtn as the student model, except that the utilities 
are preset and remain constant throughout, a session. The utilities of 
this model are adaptiyely estimated prior^to the training session by 
tracking the performance ^6f an expert techaician as he indicates simulated 
faults or they are set based on a priori expectations of expert trouble- 
shooting behavior; * 



The ACTS includes an algorithm for calculating the conditional prob- 
abilities of. action outcomes. Conditional probabilities are of the 
form: 



The probability of oftaijiing a particular measurement out- 
come, given the previous measurement outcome history, and 
the .measurement. 

These conditional probabilities are obtained by the ACTS algorithm from 
the a priori fault probabilities, PK, by the following formula: 

P * I PK . i PK • ■ 

1J KeOij - KeS ' 



Where S is the current set ofj&dlts, Oij is the subset of S for which 
the outcome of action i is* the j'th outcome. Jhe a priori probabilities 
are obtained from an expert technician during the development .of the task 
fault model* - ' 

2.3 A ^ Instructional Logic . The fourth- major functional unit of the 
ACTS computer program Ts the instructional lpgie which selects the in- 
^ struction and aiding information, for the student. The instructional 
.logic checks for convergence of the student's utilities, compares th 
student's .utili ties with those of the expert, and"compares the student's 
expended cost with that of the expert fir the same problem. These three 
condition checks are then used to select or modify the following messages: 

' Your choices indicate tha£ you are inconsistent in your 
• troubleshooting" strategy. Before making a choice, consider 
carefully the uncertainty reduction, fault isolation, and 
' ' 'costs associated with' each choice.. 



Congratulations. Your choice's show that-you are consistent 
in your strategy for troubleshooting. However, there may 
stilj be differences between your strategy and the expert's. 
If so, the next page will describe these differences. 

------ j! _ . m 

Yqu appear to overemphasize; uncertainty reductiorrHnd~ ■— 

underemphas i re : cost. 

Congratulations. Your psrformarrce is identica-1 to that of 

the expert. You are now a qua! if fed troubleshooter on the 
JPZB circuit. 



Congratulations on repairing the circuit. Your total cost 

r 

to debug the circuit was 190. The instructor's total cost 
* would have been L20. ^ 



Priop to the troubleshooting session, the student is assumed to. have com- 
pleted the preliminary lessons on the power supply involved. Consequently* 

* * 

instructions in the troubleshooting unit are riot focused on the type of 
measurements to make or the functions of specific components or sub- 
'circults. Rather., ACTS instruction is directed toward training an in- 
experienced technician to evaluate the utilities of the alternative 
measurements he can make and to select those alternatives that are most 
effective, given theii* relati-ve Costs. 

In addition. tfc the instructions that are displayed on the basis of the 
student's decision performance, the ^CT system also incudes a HELP 
option which the student can select as desired. The HELP option uses 
the expert decis^an model to suggest which measurements to* make, their 
tradeoffs, and their relotive-overall-values. ^ 



2-14 29 



2,4 Hardware Configuration 1 ' 

* * 

V The hardware configuration for the ACTS is- shown 'in Figure 2-2. It con- 
sists Qf'^our major opponents, namely an Interdata 70 minicomputer^! 
a 64K memory, a Tektronix 4024 CRT for each subject, a console* communi ca- 

tion d evice, and an experimenter communication device, which may be either 

a CRT or a teletype. 

• The experimenter communication device is distinct from the console com- 
munication device because the structure of DOS does not allow the .return 
of status for a supervisor call (SVC) read proceed on the console device. 
It is necessary to have this status return after a carriage return is 
received so that the ACTS can be apprised of the completion of a command 
input* independently, for any., of the subjects or for the experimenter. 

• The experimenter's communication device is used to enter control para- 
meters and to terminate student sessions. The experimenter has control 
of the system, both prior to the start of a teaching session and during 
its performance. Prior to the start of a session, the experimenter may 
enter certain system parameters to indicate specrfic options which are 
to be included in the current session. JHfese parameters and associated 
options are summarized in Table 2-1. Additionally, the experimenter may . 
temrin&te a student *a£ any point during the instructional program. 

Some of. the experimenter's. opt ions are self-explanatory; those that are 
. not are listed below: 



Commercial designations are used only for precision of description. 
Their use does not constitute endorsement by the Department of the 
— Army or> the Army Research Institute, ■ — '— 
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PARAMETERS V 




OPTIONS 


* » 


L Number of Students in Session 




(1 or 2) 




II. (For Each Student) .. 




• 


• 


■ ). 


Restart? 

(If restart 4 student's performance 


t 


(1-Yes, 0-No) 


• 




file is loaded from disk) 




- ' } 




2. 


Student's Ham 




Up to 20 characters 




3. 


Current' Date 1 
Circuit to be Used * 




Up to 20 characters 


• 






(1 or 2) 


% 


5. 


Starting 'Objective 




(2 or 3) " _ - 


• 


6. 


Starting MAO Model Weights for 
Student 


• 


* 

3 values ■ * 




7. 


Simulation 




(1 -gnome operator, 

* * * 

2-real student). 




8. 


Simulated Subject Jieights 




3 values to drive 


f 




> (Objective 3 only) 




gnome operator 




9. 


Help Available? 


• 


(1-Ye*, 0-No) 


r 


10. 


problem Presentation. Sequence 
During Troubleshooting Objective 




0 - Random 

1 - Fixed^ 


« 




• 

Ay 


• 




V 






✓ 


S . . 


* • 




^ ^ 1 

* 
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RESTART - If you wish to load the student's performance data from the 
« disk. aad continue from the point that the previous session left off, 

the proper response here is "I" for "Yes." There is a single perform- 
' ance file available for storage on the disk; so, if you wish to pick > 
up a session where it was terminated, no other student sessions may be* 
run irrthe interim, since, that would change the contents df the per- 
- formance file. ' . • ' 

CIRCUIT TO BE USED - The IP28*circuit is obtained by typing "1." The 
A9000 circuit is obtained by typing,. "2". 

t 1 » 

STARTING OBJECTIVE - The troubleshooting units for the IP'28are coded as 
unit "3." The. single" preliminary unit implemented for the IP28 is coded 
as unit "2." 

- 

STARTING MAU MODEL WEIGHTS FOR STUDENT - The student utility mode-1 must 
be given some set of starting weights. The weights are, respectively,' 
for fault information gain, cbmmercMal information gain, and^cost. Type 
in 3 integer values* each' one followed by a carriage retura. A good 
starting set.of weights 'i s: , 1,1,1. The weights are normalized pri'or to 
MAU calculation. 

SIMULATION - Currently no simulated subject has been implemented;- con- 
sequently, the only legitimate response here i s*~thfe "2" for "real . 
student." 

<s ' '' • 4 

SIMULATED SUBJECT. WEIGHTS - This option will not be presented since the 
simulated subject will not be selected for the simulation* parameter. 

•; HELP AVAILABLE - When, a "1" for VYes" is input at this po\t,.an the ' 
keys from the expert model will be made available. 
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PROBLEM PRESENTATION SEQUENCE - The types of problem. sequencing currently 
available are: random - problems are selected according to a uniformly 
distributed ps uedo- random number sequence, and fixed - problems are pre- 
sented in the order of the difficulty level of the corresponding fault. 

NOTE: In Table 2-1 the parameters 1,\6, 7, 8 and 10 provide » 
information utilized in only the troubleshooting instructional 
unit. This unit is associated with objective XII in Table 2-2.; 
However, the code for this unit used in. the current implementa- 
tion of ACTS is°3 as indicated ,in the prior discussion of start- 
ing objective. The reason for this is that only one of the 
preliminary units was implemented, namely the unit for objec- 
tive II in Table 2-2, and a transition from this unit to the 
"troubleshoqting unit must take place by counting up 1 from the 
current unit. , , 

If all students on the system during a session are terminated, the ses- 
sion will terminate. Each student has exclusive access to his or her 
own terminal,' through which messages are s.ent or received. 

Messages made available to the student are of two kinds: (1) strings of 
English language text, and (2) circuit diagrams or modifications to cir- 
cuit diagrams (e.g., the brightening of a module to indicate that its 
replacement has been accomplished). 

2* 5 Instructional Approach 

2,5.1 Training Procedure . ' Training on the ACTS is provided through* a 

r t 

system of phased instructional presentations. A series of units on the 
given power supply is presented. to the student. The material begins with 
the most basic information abcwt power supplies and terminates with the 
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troubleshooting unit, which consists of a. number, of circuit fault pro- 
blems, Fof' all'- instruction prior to the troubleshooting unit, the - 
procedure is to present text material to the student, allow him to ask « 
questions and receive answers, and then give the*student a test. If 
he passes the test he is advanced tcrthenrext unit; otherwise, he repeats 
t$k current unit. When fife student has completed all the* preliminary" 
units., he begins the trbubleshooting phase of instruction. Table -2-2 
presents the instructional Objectives for both the preliminary and > - 
troubleshooting phases of instruction. ^ \ 



;ing prob^en 



Each troubleshooting problem consist^ of a single circuit fault which * 

• * • 

the student must locate and replace. On the display is shown a schema- 
tic diagram of, an electronic circuit, plus printed messages which in- 
dicate possible actions apd give information. The student selec^nis^ 
responses and types them in. on a keyboard. The student can seflect from p 
among a number of activities to isolate the fault -in the displayed power 
supply circuit*. The student can choose to take a voltage or current a 
measurement, replace any circuit module, or request help. Following a 
student's command to perform these^ activities, the ACTS program displays 
the results of the simulated activity and then indicates the next allow-, 
able attivities. 

Interspersed 'among the fault problems, the ACTS presents the instructions 
which describe recommendecCcircuit measurements and the conditions during 
which they should be chosen. After the' instructions have been displayed, 
the fault 'problems are resumed. However, "the student can request to see 
these instructions at the appropriate time by selecting the appropriate . 
command on*the display screen. % 

"Appendix B presents samples of the instructional sequence which charac- 
terize the preliminary and troubleshooting phases of instruction. 
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' \ "TABLE 2-2- . 

INSTRUCTIONAL PHASES t/ITH, OBJECTIVES 

• : v ' 

I. Given a -description of a general power supply and the IP28, the 
student will state that the IP28 is a regulated power supply as 
opposed to an un-regulated power supply and specify the distinction. 

IL Given an IP28 module and the macro-assembly of which'it is a part, ' 
the student will correctly specify its function wtthin the given t 
matro-assembly. 

* 

III. Given any of the four operati.bg conditions for the IP28, the stu- 
dent will specify which circuit modules are affected functionally 
by* this condition ^ what the effect is. 

IV. • Given any module in the IP28, and afailure mode for that module, 

the student will correctly specify the functional consequences of 
• that failure mode for a specified operating condition. 

V. Given any module in the IP28 and a fa il ur e mode for that module, 
the student will correctly indicate the value of any voltage mea- 
surement anywhere in the system as high, .low, normal, and unstable 
based on the circuit operating condition. » 

*• 

.VI. Given initial circuit symptoms, the student shall report accurately 
one of * the following; £ - * 

* x (1) Circuit is functional and needs no adjustment. 

(2) Circuit is malfunctioning. 
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TABLE 2-2 (CONTINUED) ^ 

VII. Given circuit symptoms with or without a history of pre-obtained 
measurement results, the student shall accurately select the most 
likely failure modes. 

VIII. Given a set of possible failure modes, and a set of symptoms and 
measurement outcomes, the student will* select those measurements 

- . most likely to test those failure modes within operationally defined 
tolerances based on. the expert's MAU model. 

■ % ■ 

IX. Given a set of mgasurlments and module replacement candidates and 
a history of symptoms and measurement results, the student will 
rank them according to expected information gain, topological 
isolation potential, and cost. 

X. • "Given the attribute levels for a series of measurements or module 

' replacements the student-will select a measurement or module 
replacement to perform differing from 'the expert's top MAU by a 
value less than some deviation tolerance. 

/ 

XL Given a symptom. and measurement result history and the knowledge 
that one or more circuit modules has just been replaced, the "Stu- 
' dent will make appropriate measurements to verify/the result of 
the module replacements. - * / ' 

• • • m 

* • 4- 

XII. The student will troubleshoot a non-functional circuit having one 

or two faults, replacing the failing modules in reverse order of 

dependency when malfunctions are causally related. Attribute 

Jeve.ls will be displayed for him. 
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2.5.2- Cons'i deration and Help . When the circuit is displayed, a mal-* 
function is signaled by displaying overt symptoms in a table of symptoms 
and .measurement o^comes. TJie student is then told that he will next be 
expected to input some action candidates for consideration. He may also 
askffor help at this point. Provided that Ahe 'HELP! option is allowed, 
a~1ielp request will provide the student with the expert's considerations, 
as shown in Figure 2-3. After looking at these, the student may .request 
help again—in which case certain tradeoff information for the expert's 
considerations will be displayed. This information Includes the cost >of 
each action, all outcomes and their probabilities for e&ch action, and 
the. fraction of faults* to be eliminated by ,each outcome of each action. 

The student next chooses his candidates for consideration. These candi- 
dates may be measurements and/or module replacements. The system then 
displays for him the* value of each attributjj^fe^each of his considera- 
tions. At this point help may again be requested if 'the 'HELP 1 option 
is set to aid the student in choosjng an action from amongst the consid- 
erations. The student may also choose immediately wit£out t help, 

2.5.3 Action Selection and Kelp . If help is requested, the tradeoff^ 
of the final considerations are then displayed. The message lVthe-same"" 
as that used earlier to~c!isplay the tradeoffs for the expert's consider- 
anions'. Help may then be requested again, in which cas^ah expert 
'ranking.^ of the final considerations, is presented. The attribute levels^ 
of the considerations are th^!\re-di splayed. 

The student may then choose 'none of^the above 1 in which case he will 

C m' 

be asked for new considerations or he may type a choice from the list 
of considerations. If his 'choice is a dmeasurement, its outcome is'dis- 
played in the symptom/outcome table. If his choice is to replace a 
module, the part of the display depicting the module is enhanced on the 
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screen. If the chosen action .did not repair the circuit, the cycle, 
repeats w,ith a request for new considerations. If the, chosen action 
correctly replaced ^the. faulty module* the overt malfunction Symptoms, 
are corrected on t;he screen and the system enters an evaluation phase* , 

£.5.4 ^valuation (Feedback) Phase . When the evaluation phase begins, 
the student^ti first congratulated* on having repaired the. circuit and . 
given his total expenditure to compare with what it would have cost the 
experts If his utility model has converged, indicating Jthat he is using 
the displayed attribute information in a-cpnsistpnt mannerj^he is told 
that he is now cpnststent; otherwise, he^is told to weight the attribute 
information more carefully. 1 If his utilities differ significantly from 
the expert's, he. is told which ones are high and which ones are low; * 
otherwise, he is congratulated as an expert and instruction stops; .Pro- 
viding that h,e $a's~Vot yet converged to the expert's utilities, the 

system 'advances to the next, ci rati t fault problemand again presents 
* 

malfunction symptoms. ^ k v - 

* «• * , * 

2.6 Software - 

Two Percep"tron>cs' documents are available which describe the ACTS soft- 
ware. The first, PFSS-1076-79-8, is" a description of the software speci- 
fication forthe ACTS. The specifications are accurate f6r -the. configur- 
ation of the ACTS software. as of the time the fi^st experimental study 
was conducted. As a result of the study, some changes were made which 
will be described in Chapter 3, but' the changes do not fundamentally 
alter 'the specifications as described in PFSS-4076-79-8. This document 
includes a description of the function as well t as of the structure of 
the software, including the o various files needed, to run the system. Also 
programs for instructional "objectives are described. 



'The second document* PDCMDM-1076-79-7,. is a manual for developing new 
circuit modules for the ACTS. Generalized techniques $nd step by step 
procedures are included to aid circuit model developers in creating 
instructional material, circuit-specific parameters, and software neces- 
sary to fully utilize the ACTS, The manuaj describes how* a new circuit* 

. module is createiand whaJt- instructional material is needed to familiar- 
ize the student with the characteristics of the^specific electronic 
circuit. The circuit- specific parameters jpeeded for implementing the ' 
new module in software are explained, as well gs the steps 'necessary 
for integrating the hew module with the rest of the -system software. 
Procedures for creating circuit diagrams oh the graphic display, repre- 
senting circuit specific" parameters .in da'ta.tables, and procedures ^r 
'generating circuit specific production rules are described n detcfil* 

The manual emphasizes and describes the special coi^HP^atiohs required 
fo.r integratinc^he instructor' s and 'the programmer's tasks^when develop 
ing new circuit modules and associated lessons. m 



t 3. RESJEARCtf .ISSUES — ^ 

' . * * — i 

m . , 

"b.l v Objectives ,* • % , 

• " - - 

Although the major objective of Year 1 was to 'develop and implement the 

software for the new AGTS as described ih the previous £ect ion, an 

"equal'ly important. consideration was to run a pilot study with actual 

» 

subjects, the. pilot study was'needed to jneld dat# concerning the^ut^ 
jects and the "training potential of the ACTS. The pilot data were also 
used to test the system so that appropriate modifications could be made 
for the full-scale stqdy designed fpr Yea$ 2. 

S.'i , Subjects V*o m 

Three students from the Electrical w Engineering Department at Cajiiocnia 
^tate University, Northridge, were recruited as subjects. The only re- 
cruitlng requirements were that the subjects" have Junior or Senior 
standing, or equivalent experiencfc^and that (they have a good working 
knowledge of English. The purposes vgf these j requirements were, at 

first, to mirtijnize the need for extensive preliminary training: so that n 

I 

-the subjects' time could be primarily devoted to obtaining data oh the - 
troubleshooting objective, and second* to avoid possible confounding ef- 
fects due to difficulties ifi understanding tjhe instructional te*xt asso- 
ciated with the ACTS.' , 1 

• ' *- «fl J 

Some background information on the subjects, Was obtained" by means. of a 
preliminary questionnaire. Tne subjects wdr$ between 19 and 23 years of 
aye, and they all had some experience in troubleshooting electrbni^cir- 
cuits^'as well as in Interacting* with computer-based systems. -One fe- 
male and two male subjects signed up* for the experiment, *which required 
two sessions, each lasting between 4 and 5 hours. They wej*e paid at the 



'base rate bf $5*00 per hour and, as an incentive, were told that they 
could earn additional, pay for good performance at a rate of up to 
$4*00 an hour. Good performance was determined after the data wfere 
collected by comparing the- three subjects*' results with each other. 
The subjects were paid by mail, following tljg completion of their two 
sessions* ^/ • * 



3.o v Instructions . 




When the subjects arrived for their first session, they were told that 
they were to participate in*a study designed to tnain effQptive troub- 
leshootiny of an el'ectronrc circuit. They were seated at th§ console 
and were given a handout which contained an introductioa to the task and 
to concepts relevant to power supplies in general, and to" the IP28 in 
particular. In addition to this. introduction, a troubleshooting guide 
was included in the handout in which measurement ^outcomes were defined; 
also a table of the probability of occurrence of .module faults was" 
yiven, as well as a table specifying the forrespondence between faults • 
ana measurement outcomes^ An additional table listed the responses 
recognized by the ACTS-*and their corresponding measurement or replacement 
costs. The handout is reproduced in Appendix A. The subjects in the 
present study felt that the handouts* were quite clear, 'and they reported 
having no problems in understanding the concepts^ that were present ed* 

* n 
X * ♦ 

The subjects were rufi individually,* with the experirtiefttnir sitttng at a 
table nearby. AfW having read the handouts, the subjects completed 

* A. 

the preliminary objective presenttol on the CRT, as discussed in the pre- 
vious chapter. Any question was ar^wered by paraphrasing the written 
instructions. 



J. 4 Sequencing <~ - 

currently; ihe sequence in wlyieh problems are presented to the student 
can be \\) one of. two modes, random or fixed. The fixe'd sequence is a 
function of the level of\dTfficulty of the problems /with easy problems 
being presented at the beginning, of the instructional sequence and 
becoming increasingly more difficult as the sequence progresses. The 
major criterion for determining the Vevel of difficulty of a problem was 
the logical complexity requited fpr solving it. The minimum number of 
measurements required for isolating a fault was not a criterion of dif- 
ficulty. For example, the faults of probjems #7 and #8 Can' both be iso- 
lated by understanding the relationships between the. initial (given) 
symptoois and the functioning of the modules, but it is rated as medium 
in difficulty because .it assumes *a high level of understanding of the 
modular function^g^and interactions ^within the circuit^ ' 

'** * * ... 

Level of diff lcul^f was defined as follows: * - ^ r ~^ 

U) .Easy problems—simple fault isolation. 

; \Zj 1'ieS^umi problems-- fault isolation requires sequencing of i 
measureraiants and understanding of modular functioning and 
interactions within the circuit. 

(3) 'Difficult problem's- -fault isolation is in a feedback^ loop, 
reauiMng mul ti pi e measurements clnd a high level of under- 
4 standing of the "circuit action. 

The pro^lerii numbers, whfch were not shown to the subjects, reflect in- 
creasing levels of difficulty, as defined above. Thus, for the fixed 
sequence, subjects were given problems #1 through #14 sequentially; for; 



i 



the random sequence, the problems were simply selected randomly* In the 
present study, the random sequence was preprogrammed and was not random- 
ized anew for eatffsubject ; this was a temporary simplification that 1 
will be changed for the Year 2 study. 

3.5^ Results and Analysis 



— During the troubleshooting part of the study, the students were allowed 
to, refer to the tables in the handout .which provided information con- 
cerning the types of measurements that are permissible and the charac- 
teristic outcomes, for any given fault. 

* ~* 

The students', responses were colfected and printed out at the end of 
each problem. In addition, the experimenter noted the number of times* - 
the student asked for help ana the amount of; time needed to solve each 
problem. Information concerning the attribute levels of the students' 
considerations'^^ also recorded by the experimenter. 

During the first session, two of the students were given the fixed 
^presentation sequence, and one student the random presentation sequence. 
Tms order was reversed for the second session. 

* 

3»5.1' General Results . Table 3-1 summarizes the data on several per- 
formance measures. The subjects' performances are reported individually 
for Sessions 1 and 2. The presentation order" of the problems can be in- 
ferred from the problem number: consecutive problem numbers represent" 
the fixed sequence, and noTi-consecutive' problem numbers the random se- 
quence. < 

♦The first column of Table 3-1 identifies the subject, the session (1 or' , 
1) and the problem number. Columns 2 through 6 represent summarized irf- 
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~ SUMMARY' OF SUBJECTS' PERFORMANCE 
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Differences between expert and students 
2 mean of absolute #alues for 3 attributes 



formation on each subject's performance*. The last column is used for 
comments. "Converged" means that the subject's utilities came to match 
those of the expert within ascertain tolerance limit. In the present 
stuay, convergence automatical Jy stopped the session because the subject 

^as assumed to have become an expert. Subject 1 converged in both ses- 
sions and Subject 3 converged in t the, second session, "Maximum time 11 
means that the session was ended because the 5 hours allotted to it. were 

^ujsed up. This happened for both Subjects 2,an$U3 in the first session. 
Uurfny the second session with Subject 2, the system went down and, the 
session was ended for that reason, v 

• * 

3.5.2 Expert's Model * Of the five performance measures reported, 
three of them represent comparisons between the subject's performance 
*^and that of the expert. The expert's performance—namely, the sequence* 

„ of measurements and module repl acements— was determined theoretically by 

r 

applying the expert's model to the attributes under consideration, name- 
ly the reduction in uncertainty, the expected fault i solationj^ajid the 
cost of the action. Initially, the utility levels for the expert were 

set in such a way* that the attribute of cost was given a slightly higher 

— - * ^ 

weiynt than the other two attributes, decrease in uncertainty and fault 
isolation.. Given .these assigned attribute weights, the expert's model* 
was simply applied to the system to determine the best action sequence 
for each fault. This sequence is sh'qpn in Table 3-2 for each fault. 
The number of the fault corresponds to the'fault numbers identified with 
the AGTS programs: they are only used for identification and were not 
shown to the suojects. The sequences of measurements aryi module re- 
placements shown in Table 3-2 represent the best expected performance in 
the long run, although, they may not be optimal for any particular fault. 
That is, in any particular case, it is possible for a subject to isolate 
a fault more cheaply than the expert, or by using fewer measurements, 



■ -TABLE 3-2 -* 
OPTIMAL DECISION SEQUENCES (EXPERT) 
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_____ \ TABLE 3-2 (CONTINUED) • 

EXPLANATION OF -ACTION CODES: . 

4 

Any three letter sequence corresponds to 'a module replacement. The ful 

» . -=- 
meanings of each module replacement abbreviation are given bel6w: 

TRA - Transformer . . - . ' 

REC - Rectifier ^ : ^ 

SOU - Current Source 

SER - Series Regulator , 

SEN - Current Sense 

LIM - Current Limiter 

VOL - Voltage Limiter - • N 

REF - Reference Rectifier and Filter . . * / 

REG " Reference Regulator ' * ' ' 

STA - Output Stage . 

(See A-12, Figure 2) »■ 

The setten letter strings refer to measurements. The first three 
characters refer *to the major test point (See A-12, Figure 2). The 
neTt two characters can be any of the following possibilities: 

AC -.Alternating Current 

DC - Direct Current • - 

RE - Resistance * \^ 

V „ 

The final, two characters can be any of the following^poss/bilities : 

VR - Voltage Regulated 
CR - Current Regulated 
PO - Tower Off 



Thus, TP4REP0 means a measurement with major test point 4, resistance 
check, in power off mode. 

X 
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but in the long run, based on the multi-attribute utility model, the v 
expert's model, optimizes all troubleshootfng sequences, 

3.5.J Number of Measurements . As can be seen from Table 3-2, the'op- 
timum number of measurements required to isolate a fault varies widely 
across problems. In some cases, a fault can be isolated i^ a single 
measurement, while in others, as many as five measurements are needed 
minimally. It would be meaningless, therefore, to list the number of 
measurements made by each subject ona given problem; rather, the per- 
formance measure reflects the difference between the number of measure- 
ments made by the subject ana tr& optimum number suggested by the « m 
expert's model, ' N 

/ . 

The difference between the 'subjects^ and the expert's number of measure- 
ments is shown in column 2 -of Tafile 3-1. Positive numbers mean thai the 
subject made more measurements than the expert, zero means that the 
number of measurements was the same {but not necessarily that the meas- 
^uregients themselves were identical and negative numbers mean that the 
subjects found a solution requiring fewer measurements than the expert s 
model. In this case, while the subject's solution may appear more<effi- 
cient, it does not imply that such a solution follows the rules of op- 
timal decision making. 

3.5.4 Help Option . The help optnt>n provides the expert's considera- 
tions for any'given action ^nd ranks those considerations from best to 
worst, based on the multi-attn bute iti] lty model. By continually using 
the help option, therefore; a subject could QoncetwMy isolate a fault 
and replace the correct module in the most efficient manner without 
learning the decision-making procedures inherent in the ACTS. According 
Co the built-in criteria, a subject could then become an expert -a-tr 
troubleshooting electronic circuits simply by following the expert's 
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considerations', unless the subject's utilities are differentially 
trained as a function of using help. Thus, whenever help is* used, the 
training, of the subject's model Is deactivated, implying that the 
subject's performance does not reflect any learning. 

ms discussed in the previous chapter , help could be obtained at several 
points i a the course of isolating a fault. For each problem solved, the 
experimenter counted the number of times the help option was used by the 
subjects, and thi^count is-reported In column 3 of Tabl6. 3-U, The 
number of t,imer-trelp was used varies a great deal overjy^jects, but Jt. 
does seem to reflect some learning in that the amount of help used de- 
creases over trials for all subjects. This may be^a result of a de- 
crease *in need for help, but majrVlso be a function of the instruc- 
tions. Although the subjects were urged to use the help option whenever 
necessary, the instructions did specify that help should be used as 1ft 7 
tie as possible so that their performance would reflect the course of 
learning the decision-making procedures of the ACTS. 

/ « 
The data also reflect a certain correspondence between the amount of 
help used* and trie difficulty each subject experienced with the system, 
bubject 1, who converged rapidly in both sessions, only used the help 
option for the first*two problems} while Subjects 2 e^nd 3 used it 
throughout the first session. In all cases, the amount of help used 
during the second session was noticeably less than during the first ses- 
sion. An additional reason for^he decrease m^thejuse of help is that* 
the handout provided the subjects with sufficient information Tor them - 
to make reasonable selections without the us#'"# help. That is, the 
tables gave them all the options necessary to effectively troubleshoot 
the circuit. 
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3.5.5, ■ Util ity Differences . Changes over time in the differences 
between the subjects 1 utilities and thbse of the expert reflect the 
adaptation of the subjects 1 behavior to correspond more closely to that 
of the expert. This comtfs about as \ result of the feedback provided at 
the end of each problem which informs the Subjects when they appear to 
weigh one or another of the attributes too heavily or too little. 
Chan<j^£thei r behavior in response to this feedback causes their utili- 
ties to/^radu^l ly match those of the expert, producing convergence of 
the two models. 

The differences between the subjects* utilities and those of the expfert 
are shfewn in column 4 .of Table 3-1 and in Figures 3-1 to 3-4. Column 4 
of Table i-i and Figure 3-1 show the me^rof those differences, while 
Figures 3-2! to 3-4 show the chan§er*Tn the utility differences for the 
individual attributes. Since some of the utilities are negative, the*^ 
mean was calculated by taking the absolute differences between subjects 
dpu experts, * 

The utiluy differences on individual attributes appear almost erratic 
from problem to problem, but wjie"n the mean of the differences is used, 
tne progression of the subjects* behavior is more apparent. ~ 0 

Although all performance measures suggest that some learning is taking 
place, utility differences" probably reflect convergence of the two 
moaels, and hence learning, better ^han any of the other performance 
measures. This learning is readily reflected in Figure 3-1. ; ' 

From both sets of data, the individual and the mean differences, it is 
clear that Subject ! became very rapidly famibar with the System, a 
result wriich is also reflected in the amount of help used and the time 
taken per problem^ A similar result was obtained for Subject 3: all 
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performance measures improved over time, even during the first # session, 
including his decisi^-ipakihg performance, even though he only converged 
dunrig the second sessidn. , 

While convergence of the utilities appears to be reflected in similar 
improvements on the other measures, the obverse is not necessarily true. 
Improvements can be observed on some measures without corespo'nding con- 
vergence of- the utilities. For example, the amount of help used and the 
time taken per problem aid improve over trials for Subject 2, but his 
utilities -remained quite stable across all problems, suggesting that' 
this subject was, not learning to match the expert's model ara^fchat he 
was not making effective decisions. - 

The above seems to suggest that severalties of learning take place 
during an ACTS session, a consideration which will be further investi- 
gated in Year 2. , . 

• i v ■ ■ \i 

Decreases in utility differences mean that -subjects are learning to 

troubleshoot the circuit .efficiently with respect to their decision-' 

making behavior, and 'are Correlated with the concept of convergence. 

, ♦ - , - • 

For Subject 1, the mean difference drops below .20 on the second problem 
already and remain* there for all the other problems; thus, Subject 1 
converged to the expert's model almost immediately, matching her deci-, 
sion tretrav^or to that of the expert. t It is 'equally clear from Figure 
3-1 that Subject 2 did not Gtfnverge: the mean differenc^ topped once to 
less than .21), but th,en l ncreased ;agai n; Subject 2 therefore, did not 
learn the appropriate decision behavior. The curve-for Subject 3 ap- 
pears to tend towards "convergence in^the first session, but then the - 
difference increases again on problem 7; -during the second session, on 
jjie. other J}and-,_the meaa 4iU444^y-d^f fe^ 



ject 3-*did athieve convergence. 
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3.5 # 6 % Time Per Problem . "Of the Jive hours allotted to each session, 
approximately one hour was used up f>or the instruction and the preli- 
minary objectives Even thoitgh there is a* real time clock associated 
imh the Interdat.a 70, software considerations, mostly a lack of suffi- 
cient computer memory, precluded the use of it. As mentioned, there- 
fore, the experimenter clocked the amount of time needed for each prob- 
lem. This provides a perfectly adequate measure, given the range of 
times needed t9 isolate a fault. ^ 

Time per problem- varied widely across subjects*, but decreased dramati- 
cally o^er problems for all subjects, the greatest decrease being ob- 
served between the first and second problem. A decrease over the two 
sessions. is also clearly evident, as shown in column 6 of Table 3-1 and 
in Table 3-3 which 'gives the mean time per problem in the two sessions 
for each subject. The actual' number of minutes spent on each problem is 
shown in. Figure 3-5 for each, subject. The two sessions are i ndicatecFby 
a break in Ua^aarves for each subject. Since the number of problqnsj 
solved varied across subjects, the breaks do not occur at the same place 
for each 'subject. 

Figure j-5 clearly strqws the sharp decrease in the amount of time needed 
per problem, especial ly^OVer the first vh§ problems for Subjects 1 and v 
3. • Subject 2 required so much time for each problem to Sessional that 
he was only able to solve three problems in the allot^ad^time (approxi- 
mately four hours). However, much saving can be tffJserved^-at the begin- 
ning of Session 2 (from 45 minutes to 10 minutes). 

These decreases in time and savings over the two sessions are primarily 
Attributable to increases. in familiarity with the .system, including the 
c onsoles, t he types of allowable measur ements , and thre responses td t be_ 
made. This is evident from the sharp drop observed after problem 1. 'It 



\ TABLE 3-3 
*- AVERAGE TIME PER PROBLEM 



SUBJECT 
NUMBER 



SESSION 
1 



■NUMBER OF 
PROBLEMS 
SOLVED 



SESSJON 

•2 



NUMBER OF 

PROBLEMS 

SOLVED. 



27 min 



15 min 



70 min 



10 pin 



23 min 



14 min 



■ 5 




f 



FIGURE 3-5. — 

NUMBER OF" MINUTES SPENT ON EACH 'PROBLEM 
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is t\pz t attributable to the difficulty level of the problems, si nee the 
difficulty level for Subjects 2 and 3 increased over time, and was ran- 
dom for Subjefct 1. It is clear that for the Year 2 study, a few prob- 

* 

lems must be presented to all subjects to familiarize them with the 
operation of the system if meaningful evaluations are to be obtained 
from the various experimental groups. 



Number of Problems Solved . Column 7 of Table 3-1 gives the number of 
problems solved by each subject* As with the other measures, this 
varied a great deal over subjects. Two factow^contributed to^this. 
First, there was a time limitation as discussed earlier. Thus Subject 
2, wtfSSe mean time' for' Session 1 was 70 mvrftjtes per^problem, was only- 
able" to solve three problems during that time, 1 in contrast to Subject 3 
wno solved seven problems. Second, the parameters of the program were 
such that when a subject-' s utilities converged - the subject was de- 
clared an expert, and the program stopped. This is what happened in the 
case of Subject 1 who learned very rapidly to make efficient and- con- , 
sistent .decisions, and thus become an expert within a few .trials. 

Stopping the program when a subject becomes an expert may provide an- ef- 
ficient v/ay of using the ACTS in^an actual training situation. For ex- 
perimental agd evaluation* purposes, however, .it is necessary to have a 
great deal of data that are comparable across subjects. For this rea- 
son, cms opt ion- will be changed in the Year 2 study. .Even if subjects 
uo' become experts, they will continue to solve problems until the number 
of prq^lems specified in the experimental design have been run., 

o.b.'/ Debriefing Questionnaire . The siiljects were given a debriefing 
questionnaire at the end of the first session, as shown in Tabje 3-4. 

4*MjeneraT-, VI 1-sub^cts- felt— that they hacH earned-tor optrrmtze the^ — — 



types of measurements to make in order to isolate the fault as effi- 
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• TABLE 3-4 
/ -. -DEBRIEFING QUESTIONNAIRE 

1* Do'you feel you learned anything? * If so, what? 



If not, what would you have liked to learn? 



2. Were you confused about anything?' What? 



3. Did you find th& "Help" option useful 
4<, . In general, did you agree with the. expert's. suggestions? 



5. Would you have liked more help? 
If yes, for what actions? 



In /what format? 



In/w 



6. Please make any comments or suggestions you feel may be appropriate. 



We appreciate your contribution tS^ and participation in,, this experi- 
ment. — Thank you. . - \— — — 
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ciently as possible. However*, all subjects also answerechpositi vely to 
'Question *2, asking if they were confused abotft anything; One sabject 
aid not understand what the experts choices were based on, another sub- 
ject felt that the "computer was inconsistent with its input," and the 
third v subject wondered about the purpose of the modules and their rela- 
tionships each other*. They all felt the "Help" option was useful and, 
ir'i general, agreed with the expert's phoices. Only one subject (Subject 
c) did- not want help; the other two would have liked more help iii under- 
standing .the information provided by the expert, perhaps in the form of 

an example in 1 the handout, and an explanation of how the expert's 

* - * * 

choifces were arrived atl These problems are the result of the abbrevi- 
ated use of preliminary objectives and will be easily remedied in the 

future. . - ^ 

? — * > 

3.6 * Pi scussjon 

i.6.1 Learning Effects . Overall, the results appear promising in * 
terms of the training potential of the ACTS. A gre^t deal of learning 
*pped£5 m t-akea-plaGe -on ^1 1 performance measures- ^and much of this 

learning transferred from one session to the rtext, This is encouraging, 

r 

considering that the two sessions were separated by at least one week 

sfior all subjects.. Even Subject 2, whose utilities did not converge to* 

those of the expert, shows transfer of learning on the amount of help 

used ana the time taken per problem. Subjects I and 3 e'xhibited learn- 

my and transfer on all performance measures. 

*» i *» 

From the figures, it is clear that a great deal of the learning occurs 
in the initial trials; and this is probably more likely to be related to 
the professes of familiarization with, the equipment and the task, than 
to.. the acquisition, of deci si oo^jnakijig-^trategi es. JL However , the f igures- 
also sugyest that this familiarization proce&Tdoes not take .more than 



one or two trials. In order to eliminate these effects in the Year 2 
study therefore, the first sessiorrwill begin with the presentation of 
one or two randomly selected problems which will serve to familiarize , 
the student with the mechanics of using the ACTS,, the feedback format, 
and the various types of help. 

3.b.2 Sequencing Effects . The question of different effects attri- 
\ ' butafcle to the sequencing of problems cannot be answered at this time* 
^ since the differences in the subjects' .abilities were so*large and so 
fewsubjects were available. Effects of sequencing will depend a great 
deal on the accuracy with which problem difficulty can be identified. 

i * I 

From the results, it apears that some problems which 'were identified as 
■ -"- % - somewnat difficult, were in f3ct easy for the subjects to solve. There 
are at l^asi; two confoundi ng, factors which impinge on the interpretation 
of the prob-lem difficulty. One will be discussed below under "Use of 
r Handout", tne other is concerned with the level of the studepts' abili- 
tyf for college-level students, having some background in electronics, 
problems identified as being of medium difficulty may in fact be* as sim- 
ple as the easy problems , -since difficulty is related to the logi^al^ 
0 . Complexity in zhe circuit, and college students have had much practice 

in dealing with logical complexity. This may not be true for high - 
school students who may have h3d less experience in dealing with logical 
' complexity. t , « 

In order to avoid this problem tn the Year 2 study, a base rate for 
problem difficulty will be established using performance on the random 
sequence, a problem's level of difficulty, therefore, will be empiri- 
"Sally rather than logically determined. Although this violates the 
standard practice of random assignment of subjects to groups, the bene- 
fits of tins' approach outweigh t r he dangers af partially violating the 



eric 



random assignment directive. ^ 
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3.b.3 Use of Handout . The first factor mentioned above, wh'ich would ^ 
prevent evaluating sequence effects, has to do with the use of the han- 
douts., and especially, the availability of Table 2 of this handout, 
f showing the match between module faults and measurement set. This table ' 
shows exactly what. types of measurements should be made, given different 
types of initial outcomes, so that, a bright student can in fact i^se this 
table exclusively, without ever using the l\elp option. All the, students 

in the pilot study tffs covered this quite rapitiTy. ( * - 

i 

The use of such a handout is acceptable as a trailing device, but there 
arfe at least two considerations to keep in mind; The first is that the 
ACTS only incorporates single faults* and the characteristic measurements 
obtained are fairly straight forward. In an actual trou^/fe^hooting en- 
vironment, however, there is po guarantee that % faulty circuit will 
have a single* faul t; a, breakdown could be the result of a combination of 
faulty modules. Obviously, in such a case, the measurements would not 
be as straightf orwarfi as those lasted in Table 2 of the handout. Meas- 
urement outcomes in the ACTS are given aa high, ^Ormal, low, or zero, 
but in an actual' environment , the measurement outcomes are numbers which 
nave to be evaluated. For example, an outcome that is si ightly-above 

7 

normal could in fact be normal or high. This type of decision cannot be 
trained by, the current version of the ACTS, and its possible effect. ih 

s 

evaluating tranSfer'to actual equipment will have to be kept in mind. 

The second consideration in. the use of handouts concerns the types of 
learning that can take place during an ACTS session. On the. one hand, 
one may emphasize the cognitive aspects of training to troubleshoot a 
circuit. In this case, it is advisable to use as many cognitive aids 
(such as handouts and charts) as possible and to emphasize background ^* 
knowl^frge* — On-t-he-otfter-h-and, the ACTS- can also be viewed u^s a more - 



mechanistic training .device where responses become differentially rei(£* 
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forced through a conditioning process. That is, it is qui te m conceivable 
that the appropriate responses, those which correctly utilize the attri- 
bute information provided, will become trained simply as a result-of re- 
•peated trials with fairly immediate feedback. In this case, the use of 
cognitive aids would not be beneficial. Thus, whether handouts or other 
aids are used in .conjunction with the ACTS must be determined in rela- 
tion to the cognitive abilities of the students using the ACTS^nd to , 
the training objectives of the school. T '~ 

For the Year 2 study, a combination of these two extremes has been selected. f 
The handout will be made available to the subjects during ini ti^JUtpining, 
for approximately three problems, to give the subjects. an opportunity to 
understand the relationship between measurements and module faults^Fur- 
ther training, however* wi 11 be done without, the handout. 

> 

3,6.4 Sliding Window . Aside from the improvement already discussed, i# 
a change in thp sliding window was made. The sliding window refers to 
the number of problems over which the training weights are calculated. 

The sliding window of size N consists of training information for the last 
N choices selected by the student during decision cycles where help was 
not invoked. Decision cycles involving help disallow any student model 
training and thus are not involved in constructing the window. Two 
statistics are available from the window: (a) total number of times 
training occurred out of N, and (b) sum of the absolute values of all 
adjustments to the model for these N decisions. 

In the pilot study, the sliding window parameter was 3, so that the utility 
weights were calculated for problems 1-3, 2-4, and so forth. This tends 
£o produce very rapid convergence, with some probability of spurious 
results. It was therefore decided to make the sliding window dynamic, 
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which means that the parameter can be changed according to current needs. 
For demonstration purposes, for example, when rapid convergence is desir- 
able, the size /f the window can bte made small, but during an experiment 
or for training, the parameter can be accordingly increased. • f 

/■ .*' • -• 

$/6.5 New performance .Report Printout . On the basis of tfie pi Tot . 
studies performed, the performance report has been completely revised, 
primarily $o obtain more detail of the subjects* behavior. The new report 
is shown i/n Table 3-5. Table 3-6 explicates the report. For each action, 
the •student's considerations, attribute levels and expert's, choices will 
be printed out; the actual action selected and its*£utcome will be shown, 
as well/ as ongoing changes in the student's utilities. This differs 'from 
the pi/lot study in jthat information is obtained after each action, rather 
than just at the end-df each problem. Overall, this report provides'a 
performance record which traces eVery decision make by the ACTS student. 



/ 
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PRINT-OUT REQUIREMENTS FOR • 
ACTS80 TROUBLESHOOTING OBJECTIVE 



. ( 

STUDENT:- 
CIRCUITS 
HELP AVAILABLE: 
SLIDING WINDOW: 



AGE: 
fAULT: 



DATE: 



FEEDBACK AVAILABLE: 



STUDENT INPUT SEQUENCE: 



STUDENT'S , ATTRIBUTE 
CONSIDERATIONS < LEVELS 
V. 



EXPERT'S CHOICES 
(WHEN "HELP" IS USED) 



ACTION SELECTED: 
ACTION OUTCOME: , 
SUBSEQUENT UTILITIES: 
UTILITY DIFFERENCES :£ v 

TYPE OF HELP: 

(PRINT AFTER EACH ACTION) 



UTILITY RATIOS: 

SLIDING WINDOW PERFORMANCE: 

CLOSENESS TO EXPERT: 

CONVERGENCE: 



STUDENT WEIGHTS: 
STUDENT CpST: 
'COST: 




1 



1 



lt, TIME M TO 8E FILLED OUT 3Y EXPERIMENTER 



EXTRA SPACE FOR OTHER COMMENTS 

- V 



t 



V 



I... 
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TABLE 3-6 
REPORT CONTENT DEFINITION 



_ . c 



The Information content for each label in the ACTS80 Troubleshooting^ «>. 
Printout H described below: ■ , : - 



"STUDENT 
AGE 
DATE 
: CIRCUIT 

FAULT' • 

HELP ^AVAILABLE 

FEEDBACK AVAILABLE 
I 

SLIDING WINDOW 



Student 4 ! name , 
Student's age 
Oate of experiment 
"1 - IR-28 £eW su PP lv ^ 
2 - A9000 power t ;3upply 
FauTt no.dfor current problem 

1 * yes 
0 - no 
yes 
.The no 




The no., n' f qf most recent action choices used to 
checfc for consistency in -student txtfel * . * 

•JTUDENTS CONSIDERATIONS The names of the actions that the student^ considered 



/ATTRIBUTE LEVEL? 
EXPERT'S CHOICES; . 
ACTIpN SELECTED 0 * 
ACTION OUTCOME * . 

SUBSEQUENT UTILITIES* 
UTILITY DIFFERENCES 

UTILITY RATIOS 

SLIDING WINDOW 
PERFORMANCE , 

CLCfSENESS TO EXPERT 
.CONVERGENCE • 



TYPE OF HaP 



' « STUDENT WEIGHTS 

. STUDENT COST 
^PCPWT COST 



The attribute levels far the 'student's considerations 

The expert's considerations by-name 

The name of the" action chosen by the student 

the outcome of thj8 action performed (e.g., "L* 
for low) 

The student's mode 5 ^ values after the action, < '* 

The differences between- the, experts and the 
student's model va!6es . # 

, The ratios of the student's utilities 

The amount of training occurring over the most 
recent n decisions 

The cosine of.the angle between the expert's and 
- student '-s w41$tft vectors -- r *± - -— - — - 

Yes - Small amount of training of student's model 
'over sliding window 1 * 

No - Laro>r amount of training of student's model h 
over .slfdfng window 

'I * Expert's considerations requested v \ 
2-- Expert's tradeoffs for expert's cpnsflferatlons 
% requested ' f T . - 

3 - Experts. tradeoffs for student's conji derations 

requested \ F ,\ 

4 - Expert's ranking of student's considerations 

requested * - 

* Student's model weights , ' \ tK f S 

Student,' s cost for current problem s 1 % ' *> 
Expert's woutd-be cost for-current problem - * * 



1 

•V 
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APPENDIX A 
STUDENT HANDOUT 

Introduction • 

You are a subject in an experimental program designed to help develop 
computer-assisted instruction for-teaching'electronic troubleshooting. 
The system enables you to get actual troubleshooting experience in a 
simulated environment.. You will -work with a computer terminal which has 
a keyboard and a CRT display with qraphics capability.- The goal of the 
current experimental serTB.is to -evaluate the teaching effectiveness of 
the system under various experimental configurations.' Specifically* we^e 
interested in how much and how fast you learn as you work with the system. 
On-line measures will be used to evaluate your learning progress and to 
adjust furtHey; instruction to your learning needs. ' . 

You will be working with the Adaptive "Computerized Training .System (ACTS). 
The ACTS is adaptive in that ft' learns' the troubleshooting behavior of the 
.student. For' this reason it is important that you be as consistent as 
possible in your approach to troubleshooting. The more consistent you 
are, the faster ACTS will be able to learn your particular values and^ 
give instructional feedback which is* responsive to7 your learning needs. 

♦ > * 

Included here-in is an introduction to power supplies, which you should 
study in order to learn the background. material required for your on-line 
troubleshooting practice. Following the introduction will be a trouble- 
shooting guide,' which Is to be 'used for reference during troubleshooting. 



INTRODUCTION TO POWER SUPPLIES 



A power supply is a^sourcebf electrical energy. It supplies the energy 
needed by various circuits and electrical d^jcets to* function. These cir- 
cuits and electrical devices, being users of electrical energy, are known 
as Iqads. The purpose of a power supply is to provide electrical energy 
or power for use by a load. 
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A power supply may be ei ther self-poptained, such as a battery /or may 
transform one form. of electrical energy into other, more u^Vul forms. 
In this discussion, v*e are concerned with the latter. 

4, 

Electrical energy exists in many different forms and levels. Two primary 
forms are alternating current, or A.C., and direct current, or D.C. A.C. 
is characterized j>y a constantTyyChangi ng wave of electricai energy, where- 
as D.C. is characterized by a constant, non-changing level of^electrical 
energy. The magnitude or level of an A.C. or D.C. signal may be of any 
nunerical value, an example being a high level (100), or a low level (10>. 

Often, the energy requirement of form and magnitude of a load cannot be 

met By the available Source of power. -An'example of this would be* a load 

requiring a low level D.C. with an available source of power 'of high level 

A.C: A power supply may be used to convert the high level A.C. to the low 

level D.C. required by the load. Such a power iupply would have an input 

to which the. source of power would be applied, and an output through which 

the converted D*C. would be supplied ta the load. A power supply may^be 

used to match the requirements of a load with the characteristics of a\ 

•available power source. . ' 

• ■ # " 

* 

* - 

r 
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INTRODUCTION TO THE IP-28 POWER SUPPLY 

The IP-28 power supply i's designed to perform specific operations under 
specific conditions. Understanding these operations and conditions will . 
help in understanding the IP-28 power' supply. 

The IP-28 converts a single A„C. input into a single D.C. output. All 
power used for operation of the IP-28 comes from the single A.C. input. 
All power used by the load comes from the single D.C. output. 

Certain characteristics of the IP-28' s D.C. output are maintained, or 
regulated, at a constant level. This regulation is achieved in the IP-28 
by monitoring the output characteristics, and acting to correct any changes. 
The output characteristic of voltage, or level of electrical energy, and 
the output characteristic of current, or flow of electrical energy, are 
both regulated in this way. Because of this, the output of the IP-28 is 

said to be current and voltage regulated. 

■» 

The level at which the output voltage and current is regulated' is adjustable 
Both voltage and current may be adjusted to regulate atjiigh or low. The 
value of the load dictates whether voltage or current regulation is taking 
place/ Should the load drain excessiv^ current from the output at the 
regulated voltage value, the current would be regulated. Otherwise, the , 
output Voltage would be regulated. . 

FUNCTIONAL BLOCKS ' , ^ 

Within the IP-28, three major 'functional blocks, the D.C. power source, 
the reference source, and the regulator (see Figure 1) operate and' 
interact lo convert power'from the A.C. input into an adjustable D.C. out- 
put. Each functional block performs specific, operations , which we will now 
consider. . . % 
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FIGURE 1. 

FUNCTIONAL BLOCK DIAGRAM FOR THE IP28 POWER SUPPL 
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COMMON 




The D.C power source Converts the A-X. input power to D.C. The D.C. out- 
put of the D.C. "power soured consists of the common line and the connection 

to the regulator. \ * 

% 

The y reference source provides an adjustable D.C. output. This adjustable. 
D.O.. output is connected to the regulatory and an output line. The reference 
source converts A.C. power carried by the\two lines connected to the D.C. 
power source to the adjustable D.C. output;. * 

The outjjut of the regutator is current or voltage^regulated D.C. .and is 
connected to the output of the IP-28. The regulator draws D.C. power from 
the- output of the D.C. pOwer sdurce and passes to the output of the IP-28 
the proper D.C. voltage or current level. The voltage level between the- 
line from the reference source to the regulator - and common, called the 
feedback voltage, is used by the regulator to regulate the output voltage. 

The feedback ^oltage level is the result of the difference between .the 
output voltage level and the reference sourceJkC. output voltage level. 
Changes in the output voltage or the reference source output voltage will 
cause the regulator to make an* opposite change iln the output voltage. 
The regulated output voltage ley el can be changed by adjusting the reference 
source output voltage. The regulated output voltage level can be kept 
constant if changes in load conditions do not-result in an excessive output 
current level. . 

, D.C. POWER SOURCE MODULES 

Each of the functional blocks of the IP-28 car> be divided into modules, 
or small functional u\rts. The subject of this discussion. is. thejnodular 
makeup of the D.C. powet* source and how these modules operate and interact 
to perform as, the D.C. power source functional, block. 
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"The D.C. power source, as a major 4 functional unit of v the IP-28 power 
supply, performs the task of converting the A.C. input power to D.C. The 
D.C. output of the D.C. power source provides D.C. power to be used by 
the regulator and to be passed to the output. 

The functiqn-of the -D.C. power source is performed by .two modules: the 
transformer and the reqtifier and filter. 

The transformer, drawing upon fhe A.C. input, produces an A.C. output 
whose j/oltage and configuration is compatible with the rectifier and 
filter module. The output of the. transformer consists of three lines as 
displayed in the diagram, Figure 1. The center line is the common line, 
and the A.C. voltage between the common center line and the two outer 
lines provides A.C. voltage to the rectifier and filter. 

t 

The rectifier and filter convert the A.C. power from the transformer's 
output lo D.C/ The? output of the rectifier and filter consists of two 
lines, one connected directly to the regulator and another connected to 
the regulator and the output conmon terminal. It is through these con- 
nections that the D.'C. power output of the rectifier and filter is r ^ t 
delivered to^the regulator. j 

REFERENCE SOURCE MODULES' _ 

The -reference source performs the task of providing an adjustable D.C. 
vdltage needed by the regulator for. voltage regulation. Modules contained 
within the reference source work together to perform this task. 

The reference supply is made up of the following .modules: 



-Trans former N 

Reference Rectifier and Filter (REF RECT & FILTER) 
Reference Regulator" (REF REG) 

I * * 

# * Output Stage 

Refer to the diagram (Figure 1) and recognize their placement and inter- 
♦connections . 

The reference source shares the transformer with the J).C. power source. 
The output of the transformer connected to the reference rectifier and 
filter is AX. arid is separate from the other transformer output. The 
transformer performs for the reference supply the task of converting the 
A.C. input voltage to an A.C. voltage needed by the reference rectifier 

and filter. , . 

§ • t — 

The reference rectifier and filter cpnverts the A.C. from the transformer 
to D.C. The output^f the reference, recti fter and ftUer* consisting of # 
'the line connected to the reference regulator and the reference common 
(REF COM) line, supplies D.C. to the reference regulator. 

The reference regulator draws upon the D.C. from the reference rectifier . 
and filter and produces a' constant^. C. voltage output needed by the out- 
put stage. 

The Itne Connecting the reference regulator to the reference common line, 
as it i^s also with the reference rectifier and* filter, is a common input 
and output line to that module. 

The output stage uses the constant D.C. voKage flrom the reference regulator 
to produce ^fT adjustable D.C. voltage output. Wi(thin the output stage is 
a means to adjust the D.C. voltage between the lin^ connected from the 
output stage to thd output line, and the line connected to the regulator. 
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In summary , the transformer converts the A.C. input voltage;* the.refereace 
rectifier and filter Changes the converted A.C, to D.C!; the reference 
regulator stabilizes the D.C.; and the output stage provides a means for 
adjusting the, D.C. These actions perform the task required of the 
reference source. 

REGULATION MODULES 

The resulator passes the proper amount of D.C. voltage or current from the 
D.C 4 pqwer source to the output. The* regulator has two modes of operation^ 
either voltage regulation or current regulation. 

1. VOLTAGE REGULATION MODULES * . 

* » * 

N 

The modules contained within the regulator which perform voltage -regulation 

are': 

Current source". (CURR SOURCE) * ; 1 

Series regulator (SERIES REG) 

Voltage limiter (VOLT LIMITER)' ' 1 

4 ' 

Refer to the diagram* (Figure If) and recognize their placement and inter- 
connection. 

The' current source provides the proper flow of current to the series regu- 
lator and to the, voltage limiter to insure their operation. The current 
source draws current tfrom the D.C. power source and outputs a constant and 
proper amount of current to the series regulator and voltage limiter. 

The series regulator is placed between the output and the D.C. power source 
so that the power to the output can be controlled * The output voltage 
level of the series regulator is control led-by? and proportional to, the 



voltage level between the line connected to the base of the series regula- 
tor and common, called tffe control voltage or control signal* 

The voltage limiter conducts different amounts of current from the current 
source. The more current conducted by the. voltage limiter, *the lower-the 
control* voltage. ' * 

The amount of current conducted by" the voltage, limiter is controlled by • 
the. feedback voltage level between the feedback signal, connection to the 
voltage limiter and common. The higher the feedback voltage the higher 
the current conducted by the voltage limiter and the lower the control 
voltage. 

2/ CURRENT REGULATION MODULES- , « 

The regulator performs both current and voltage regulation. In addition ^ 

to the current Source, the series regulator, and the voltage limiter, the 

regulator contains the current sense and current limiter modules, 

* 

Current regulation or limiting is the result^ the current limiter jnodule 
% causing a drop- in the control signal- voltage across the current sense. 

' m 

This voltage drop across the current sense is directly proportional to the 
" output current. When the oytput currerrTis at a certain level, the voltage 
drop across the current sense will be high enough to cause" the current 
limiter to reduce th^contrtfT -signal . The output current level at which 
this occurs, called tWuirrent limit level, can be changed by means of 
an adjustment within the current .sense module., When' the output current is 
less fyian ttie current limit level, the voltage drop across.' the current 
sense will "not cause the current limiter to reduce the control voltage. 
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When the output current is below the 'current limit level, the current 
limiter has no effect on output voltage regulation as performed by the 
current source, the series regulator, and the voltage limiter. If the 
output current is greater than- the current limit level, the current limited 
will lower the control signal voltage' by conducting current from the 
current source through the load to common. The resulting drop in the con- 
trol signal voltage will t:**ise the series regulator to lower *t he output 
voltage- The decrease in output voltage will lower the output current 
until' it is at the current limit level* * 
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/, * TROUBLESHOOTING GUIDE / ' *- * 

Thevdisplay will be as shown. in figure 2-. ; Each module is abbreviated with 
• the -thfe^. letters b^ightefied on your display and underlined in Figure 2? 
*' When-you mus't refer -tO/jjf module (as when you replace a module}-, it is 
necessary to -use $he_ .three letter abbreviations, the tables which follow'.' 
also 'use- these abbrev.i anions'.* Notice, that various test points are repre- ■• 
. sented on the dja^Afiffi [e.g.', TP1, TP2V'etc:). ( It is necessary to use these 
three character test point labels ,to take circuit measurements. ..The tablej 
** Mn the s lower. Te ft portion, of^e 'display (see Fisgure 2) lists the-measure-" 
merits with three tolumns corresponding to the three typ.es of measurements: 
voltage, current aha 'resistance; The outcome of each measurement you take 
is listed in the appropriate place in the table. 'Measurement results are 
* presented, in a semi -interpreted form tq-saye you the trouble of Consulting 
^_ a table of" norm*! ' values. Thus all measurements have one of -the following 

*~ » * ' *V ■ » Mi 

outcbmes. . . * : < . * - . 



^Normal tN'or bl-ank) 
Uoo^High (H) * 
-toft Low' (I) 
■ Zero (0 ! ) , " - 



X 



" C Table 1 lisV-each fault and its. probability of occurrence.- A good trouble- 
i shooter takes .these [jrobatoilit'kss-i njo account while making troubleshooting _ 
decisions. Table X uses the module abbreviations meftf.ioned ^arltter as 
well as the foil owing '"abbreviations to.Vefrer. to failures. 



. , OPN =t Opert* ' r 
* SHT = Short 
^ OUT = Output 
r TRAN Transits itSr 
* "R£S = Resistor 
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a : c . 

INPUT 



TRANS - 
FORMKR 



TP1 



COM 
i 



TP 2- 



RliCT \ 
FILTER! 



TP3 



CURR. 
SOURCE' 



SiiRIES 
REG. 



TP4 



TP 6 



CURR. 
SEfrSE 



VOLT . 
LIMITERl 



CURR. 
LI MITER 



■TPS - 



TP 



11 



REF RfcC 



5 FILTER* 

ZEZ 



REF. - 
REG. 


TP9 


OUTPUT' 
STAGE 




1 




' 1 



TPA 





VOL 


CUR 


RES 


OUTP 








TP 1 








TP, 2 








TP 3 


/* 




• * 


TP 4 






V 


TP S- 








TP d 








TP 7 


' 0 






TP 8' 








TP.; 9 ' 




4 . 




TP "A 






1 



REFERENCE COMMON 



OUTPUT 

*-f~ . 



COMMON - 

■ * 



t 
I 
i 

r 
t 

J 

. i 
i 
i 
i 
i 

7 Tlo/ 



fflGURE 2, 
DISPLAY DIA.GRA 



, TABLE 1 . • ' . 
MODULE FAULT PROBABILITIES 



J- 



TiUUULfc rMULto — 


PROBABILITY OF . 
OCCURRENCE 

( 


MODULE FAILURE 


LIM * OPN TRAN 




LIM,, • SHUT TRAN 
JC 


■09' 


REC OPN OUT. 


.05 


REG OPN RES ■ 


.06 . 


■ REF OPN DIODE 


.06 


SEN - SHT RES 


.09 


SER • OPN RES 


.11 • 


SOU 0 OUT 


.10 ' 


STA OPN RES . 


.04 - ■ . 


STA- SHT RES 


.05 


TRA OPN OUT 


.03' • 


TRA, ^0 REFOtT . 


.02 


VOL . OPN TRAN 


.10 


VOL. SHT * 


.09 ■ 



Table 2 gives, the correspondence between faults and measurement outcomes 
The abbreviations used in this table were explained earlier. Th^infor- 
mation presented in Tairh£"2 represents a substantial amount of the infor 
mation used by A he ACTS 1 expert model to troubleshoot the' circuit. You 
should find it( useful when considering measurements. 

Table 3 gives the list of recognized' responses and their corresponding 
measorement cost or replacement .cost. (When ^ module is replaced it is 
brightened on the disp»y as you will see the first time you replac4 a 
modjile. ) \ * 

- ■ - . • . - V* 



i— • 



* - • 
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TABLE 2 



HOUJU 




CIRCUIT OPERATING CONDITION 








> . 


* - 


fAL 
HOOULE 


ITS 

FAILURE 


VtSLtAGE RfGULAriOH 
OorTPI tF2"tPJTft TPS tP6 tPTW T?»^W 

DC AC AC DC DC DC DC AC DC DC -DC 


CURRENT REGULATION 
DC AC AC DC DC DC DC AC DC DC DC 


POWER OFF- 
TPTtPFTPl TP 4lf*nfe£jP3 

RE RE RE RE RE ^RE 'Rt 


r t?OpOBAT : - 

RE BE -l 


IJH 


m\ THAN 


Jk 


H II 


H 


H 






* * * % 


UM • 


SUT TRAH 


L 


L 


L 








L L 


L 


L 








L 






: .V,.,; , 


KtC 


Ot'N our 


L 


L L » 


L 


L 






L L L 


L 


L 














■ ■ • 


I4G 


Oi'H RES 


L 


L 




L . 


L 


L 


L L 


M 


L ' 


L 


L 












Hit 


-OPH DIOOE 


I 


L 




L L 


L 


L 


L . L 


II 


L 


L L 


t 












SEN 


SHT KLS 














II II 


II 


H 












— — J- 




tfR 


OPH TRAH 


L 


II 


L 


L 






L H 


L 


L 


















P OUT ' 


-i 




L 


L 






L L 


L 


L 








\ 

- — 4 






T f uS*'- 


SIA 


OPH RES 


1! 


II 


L 


II 




L 




H 






L / 










' ' .'5 


MA t 


syT RES 


H * 


II 




II 




L 




L 






Lf 






rt<A 


OPH OUT 


L L L 


L L 


L 


L 






L L L L I 


L 


L 




* 






IKA 


0 KEF OUT 


L 


L 




L L L 


L 


L 


i L 


H 


L L 


L L 


L» 


— 7 — — ^^V 






VOL " 


OPH TRAM , 


II 




'H 


II /~ 




L 








VOL r 


SMT 


L 


L 


L 


L 






L L 


L 


L 










I w 







* * 



BLANK SPACE IS HOKHAL; L • LOW; H • HIGII; 9 ■ 2ERO. V . - ' 

KfASORIHlNIS TP1 TO TP6 HADE IH REFERENCE TO COHMOH. HEASUREMENTS TP7 TO TPA MADE IN REFERENCE TO REFERENCE COHHOH. 
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TABLE 3 



LIST OF RECOGNIZED RESPONSES AND THEIR COST: 







\ 




TP1 RFPO 


tin 


TRA tQR 


TP2AGVR 


"$4' 


*TP2AGCR 


$4 


TP2REP0 


$10 


REC $10 


TP3ACVR 


$4 


TP3DCCR 


54 


TP3REP0 


all) 


cnn con 

sou $yu 


J TP4DCVR' 


$.8 ^ 


TP4DCCR 


$8, ' 


.TP4REP0 


$10 


VOL $80. 


TP5DCVR 


$8 ' 


TP5DCCR 


$8 


TP5REP4 


$10 /* 


LIM $30 


TP6DCVR 


$4 


TP6DCCR 


$4 • 


TP6REP0 


$10 


STA $50 


TP7ACVR 


$4 


TP7ACCR 


$4 


TP7REP0 


$10 


SER $90 


TP8DCVR 


$4 


TP8DCCR- 


$4 


TP8REP0 


$10. 


SEN $50 


TP9DCVR 


$4 


TP9DCC£ 


$4 


TP9REP0 


$10 


REG- $70 


TPADCVR 


$8" 


"TPADCCR 


$8 


"tparepo 


lio 


REF $70 




ATTRIBUTES { 

f 

There are three attributes which should be used as criteria for selecting 
an action: • 

lT ^Decrease in uncertainty. This is the decimal fraction (i.e., 
a number between 0 and 1) representing the proportion of faults 

expected to be elipinat^d by the considered action. 

* * * 

2. Expected faulty module isolation. This is the decimal '.fraction 
(i.e., a number 'between 0 and 1) representing the proportion of 

- 4au4ty ^no4y+e^^6xp€Gted 4 to be eliminated by the current action. 

3. Cost* This is the cost of the action. 
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APPENDIX B 
SAMPLE INSTRUCTIONAL SEQUENCES 



2.7 PRELIMINARY LECTURE 



ft lecture* covering the overall functional requirements of , the IP28 Power 
Supply is displayed. Also .displayed is a diagram relating input and out- 
put connections. ^ 




LOAD 



> v 



7 INTRODUCTION TO THE IP28 POWER 'SUPPLY^ 

THE- IP28 "POWER SUPPLY IS DESIGNED TO PERFORM SPECIFIC 
OPERATIONS UNDER SPECIHC CONDITIONS: AN UNDERSTANDING OF 
THESE OPERATIONS AND CONDITIONS WILL HELP YOU TO UNDERSTAND 
THE IP28 POWER SUPPLY. THE IP28 CONVERTS A SINGLE A.C INPUT " 
INTO A SINGLE D.C. OUTPUT. ALL POWER USED TO OPERATE THE IP26 
COMES FROM THE SINGLE A.£ INPUT. AFTER THE IP28 POWER SUPPLY 
CONVERTS THE A.C INPUT INTO D.C, HIE D.C. OUTPUT PROVIDES 
ALL THE POWER REQUIRED BY THE LOAD. 

THE IP28 POWER SUPPLY CONVERTS A SINGLE A.C. INPUT INTO A 1 
SINGLE D.C. OUTPUT REQUIRED BY THE LOAD. 

PRESS RETURN TO CONTINUE 



4 
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Following understanding of the material, the student responds by pressing 
the .return 'key., and the lecture units continuK 



i 

A.C. 
INPUT 



IP28 POWER SUPPLY 



D.C. 
OUTPUT 



THE OUTPUT OF THE IP28 IS REGULATED. CERTAIN CHARACIfc JUST ICS 
OF THE D.C. OUTPUT ARE MAINTAINED, OR REGULATED, TO MAINTAIN* A 
CONSTANT LTVEt:. THIS REGULATION IS ACHIEVED BY MONITORING THE 
OUTPUT CHARACTERISTICS, \AND ACTING TO CORRECT CHANGES'.' OUTPUT 
CHARACTERISTICS OF VOLTAGE (-LBVEL OF ELECTRICAL ENERGY) AND 
r TflE CURRENT (FLOW OF ELECTRICAL ENERGY) ARE BOTH REGULATED* 
THUS, THE OUTPUT OF THE IP28 IS SAID TO BE CURRENT AND VOLTAGE 
REGULATED. 




THE OUTPUT OF THE IP28 IS R 
VOLTAGE AND CURRENT LEVELS. 



TEIT TO MAINTAIN CONSTANT 



LOAD 

I 
I 



A- 



PRESS RETURN TO CONTINUE 




Lt)AU 



the levels *at which butput voltage and current are regulated 
can be j^jdjusted. rich or low levels may be selected to* 
hegulafefboth the voltage and the current. the value required 
by the load determines whether voltage or current regulation 
will occur. should the load draw excessive current from the 
output, at the regulated voltage value , the current would be 
Regulated, otherwise, the, output. voltage wouli> be regulated. 

regulation of output voltage or current are* adjustable and 
determined by load requirements. 

press Return to continue 



t 
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**** ** * ^ 



At the *erid of several units, which comprise the entire instructional 
objective, the student's understanding *of the concepts dfscussed in th6 
lecture is evaluated. The student may select one of the several .options 
displayed. In this example, the^*adent requests additional information 
on concept #2, * m 



i 

trtPIJT 



— >- 



IP?8 POWER SUPPLY 



D.C 
OUTPUT 



I 

LOAD 



YOU SHOULD MOW UNDERSTAND THE FOLLOWING CONCEPTS.; 

(1) IP 28 INPUTS AND OUTPUTS. 

(2) s CHARACTER 1ST ICS OF VOLTAGE AND CURRENT,, * ' 
HI VOLTAGE AMD CURRENT CIRCUIT CONNECTIONS, % 

(4} IP2S REGULATION. 

(S) CURRENT OR VOLTAGE REGULATION, 

AT riHS POINT SEVERAL OPTIONS ARE AVAILABLE i;0 YOU, 

\. \r you rm. you understand each or the concepts above, 

.TYPE "RETURN" AND YOU WILL BE ' GTVFN A SHORT TEST ON THIS " 
MATERIAL. 

2. IF YOU ARE NOT SURE ABOUT A v CONCEPT PRESENTED IN THE 

- LECTURE. TYPE THE LETTER "H" FOLLOWED BY THE NUMBER OF THE 
* CONCEPT (E.G., CHARACTERISTICS or VOLTAGE AND CURRENT) AND 

"RETURN" TH I S "ENTRY WILL PROVIDE YOU MO£E INFORMATION ABOUT 

THE CONCEPT YOU SELECT. > / 

3. IF YOH WOULD LIKE TO REREAD TH I LECTURE, TYPE "H" AND 
"RETURN . " 

$ 

FOLLOWING YOUR REVIEW OF THE LECTURE AND/ OR* ADDITIONAL 
MATFRIAt. TYPE "RFKIRN" TO REPF. T yF TMF TPST rtM TUP MATPP^ | 



4->-.— - 



« 

The student responds to the options by typing "H2 M > followed by "RETURN." 



Additional lecture material covering concept" number 2 is display^? • 
First, a statement succinctly stating the concept is di sprayed , s followed 
bya detailed example /. ^ • ■ . . 



i 

A.C. 
INPUT 



' ->- 



- • % 






& • 








IPZ8 POWER ^Sf^PPLY 











7\ 



->--—, 



D.C. 
OUTPUT 



1 , , 
LOAD 



V 



2, ELECTRICAL ENERGY CA& BE EXPRESSED IN TERMS' OF VOLTAGE* 

and cuRittN?. Voltage describes the magnitude op«electricai, 

ENERGY AND THE "CURRENT , THE 'FLOW OF ELECTRICAL ENERGY. 'v 

•SJIE^DIFFERENCE BET,WE£N VOLTAGE AND CURRENT IS ANALOGOUS TO 
THEWATEft*BEHIND A HYDRO- ELECTRICAL DAM AND THE FLOW OF 
RELEASED WATER THROUGH THE TURBINES. IN THIS EXAMPLE,, THE • 
- WATER BEHIND THE DAM IS flKENED TO VOLTAGE, ,f HE GREATjfcK THE 
WATER LEVEL GEHIND THE DAM THE GREATER I-TS POTENTJAL FOR-* 
GENERATING ELECTRICAL POWER. THE AMOUNT- OF tf^TElf FLOWING, 
THROUGH THE TURBINES IS LIK£NED TO CURRENT. 'THUS THE, 
COMBINATION OF THE HEIGHT OF THE WATER (.VOLTAGE)* AND THE . 
AMOUNT FLOWING THRQUGH THE TURBINES (CURRENT)' PRODUCES. 
ELECTRICAL POWER. * * 

PRESS CARRIAGE RETURN TO CONTINUE., ' v 



2> . 



The student is again asked to evaluate his understanding. of the concepts. 
The options are again the same. This time, the student requests to 
receive the test material by typing "RETURN. H 




i 
i 

LOAD 



YOU SHpULD NOW UNDERSTAND THE FOLLOWING CONCEPTS; 

IP28 INPUTS AND OUTPUTS , 
, (2) CHARACTERISTICS OF VOLTAGE AND CURRENT^ 

(3) VOLTAGE *AND CURRENT CIRCUIT CONNECTIONS, . 

(4) IP28- REGULATION. 

(5) CURRENT OR VOLTAGE REGULATION, 

AT THIS POINT SEVERAL OPTJONS ARE »AVA I LABLE TO YOU, 

1- IF YOU FEEL -YOU UNDERSTAND EACH OF THE CONCEPTS ABOVE', 
TYPE "RETURN" AND YOU WILL BE *G IV EN A SHORT TEST^ON THIS 
MATERIAL. 

2. IF YOU ARE NOT SURE ABOUT A CONCEPT PRESENTED IN THE 
LECTURE, TYPE THE LETTER "H" FOLLOWED BY THE NUMB ER V OF "THE 
CONCEPT (E.G., CHARACTERISTICS OF VOLTAGE AND CURRENT) AND 
"RETURN" THIS ENTRY WILL PROVIDE- YOU MORE INFORMATION ABOUT 
THE CONCEPT YOtT SELECT. 

3. IF YOU WOULD LIKE TO REREAD THIS* LECTURE w TYPE "H" AN!^ 
"RETURN." % ' * 

FOLLOWING YOUR HEy I EW OF THE LECTURE AND/OR ADDITIONAL 
MATFff I At ; TYPE "RETURN" TO RF.fETVF T»/ TEST ON TUP MftTFPTAl . 
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The first question is presented to the student. 



r 



'WHICH OF THE FOLLOWING IS FALSE: 

A*' THE 1P28 HAS A SINGLE A.C. INPlJT'AND A SINGLE v 
ore". OUTPUT,*^ ' ' $ 

B. THE INPUT OF THE POWER SUPPLY IS WHEl4 THE 
EXTERNAL POWER SOURCE IS APPLIED. 

C. THE TOTAL NUMBER OF L rNES^OR CONNECTIONS GOING, 
INTO AND OUT OF THE IP28 IS FOUR. 

v D. THE LOAD DRAWS A.C. POWER Fr6m THE OUTPUT., 

E. NONE OF THE ABOVE. 4 

PLEASE TYPE THE APPROPRIATE LETTER 'KEY, FOLLOWED BY A CARRIAGE 
RETURN, TO GIVE YOUR ANSWER. 



The student responds by typing the-answer on the keyboard,^ in this 
case, by pressing "D" foil owed by "RETURN." 



1 

IC 
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The. answer the student selected was correct* The tested concepts are 
restated* 



WHICH OP JHE FOLLOWING IS FALSE*: 

A. THE IP28 HAS A SINGLE A.C. INPUT AND A SINGLE, 
D.C OUTPUT. 

B. THE INPUT OF THE POWER SUPPLY IS WHERE THE - 
EXTERNAL POWER SOURCE IS APPLIED. 



C. TOE TOTAL *^MBER OF LINES OR CONNECTIONS GOING 
INTO AND OUT OF THE IP28 IS POUR: 

D. THE LOAD DRAWS A.C. P0WER FROM THE OUTPUT. 

E. NONE OF THE ABOVE. ! 

PLEASE TtPE THE APPROPRIATE LETTER KEY,^ FOLLOWED BY A CARRIAGE 
RETURN, TO GIVE YOUR ANSWER. / ^ 

D. / A 

CORRECT. THE LOAD J5RAWS D.C. POWp FROM THE OUTPUT, NOT A.C. 

THEREFORE, THE FOLLOWING ARE TRUE ST^i^ENTS: 

THE IP28 HAS A* SINGLff^A.cT INPUT AND SINGLE 
* D.C. OUTPUT. 

i 

B. THE INPUT OF THE POWER SUPPLY IS WHERE THE 

EXTERNAL POWER SOURCE IS APPLIED. - i 

. C. THE TOTAL NUMBER OF LINES GOING INTO AND OUT FROM ' 
THE IP'28 IS FOUR . - 

D. THE" LOAD DRAWS D.C. POWER FROM. THE IP28 OUTPUT. 

PRESS CARRIAGE RETURN TO CONTINUE. 



Followirfg recognition of the porrect answer, the studejUf responds by*. 
pres^HKj "RETURN, 11 and the second question is presented to the student- 



THE OUTPUT OF THE IP28 IS NOT; 

A. VOLTAGE REGULATED. , 
: B. ^CURRENT REGULATED. 

C. CONNECTED TO THE LOAfh 
* D. FIXED OR NON- ADJUSTABLE, 

E *. ' MADS UP OF TWO LINES. 



PLEASE TYPE THE APPROPRIATE LETTER KEY., FOLLOWED BY A CARRIAGE 
RETURN, TO GIVE YOUR ANSWER. 



V 
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The student resppnds by typing the answer on the* keyboard. .Assuming- 
the student responds by pressing' "C" followed by "RETURN," the following 



display will be presented 



r 



THE OUTPUT OF THE IP28 IS NOT; 

A. VOLTAGE REGULATED. , ' 

B. CURRENT. REGULATED. 

C. CONNECTED *tI THE LOAD. ^ 

D. FIXED OR NON- ADJUSTABLE. . > 

E. MADE-UP OF TWO LINE?. * 

PLEASE TYPE THE APPROPRIATE LETTER KEY, FOLLOWED BYlA CARRIAGE 
RETURN, TO GIVE YOUR ANSWER. \ * 

C. * 

WRONG. THE IP28 SUPPLIES D.C. POWER THROUGH T4JE D.C. OUTPUT TO 
THE LOAD. THE* LOAD DRAMS POWER FROM THE IP28'S D.C. OUTPUT.- 
THEREFORE, IN ORDER FOR THE IP28 A»ND THE LOAD TO WORK AS 
INTENDED,, THE OUTPUT^OF THE IP28 IS CONNECTED TO THE LOAD. , 

PRESS CARRlAGfe RETURN TO CONTINUE. 




The answer selected by the student was incorrect. An explanation is 

provided explaining, why the answer was incorrect. After the student 

responds by pressing "RETURN/ the*third question is presented to the 
student. 



f WHICH OF THE FOLLOWING MUST ALWAYS CHANGE THE OUTPUT VOLTAGE 

OF THE IP28: s f 

A. LOWERING *THE VALUE OF THE LOAD, CAUSING LESS 
.J ' POWER TO BE USED. 



B . INCREASING THE ALU E OH THE LOAD, CAUSING MORE 
POWER TO. BE USED. ; 

C. INCREASING ^E^CURRENT REGULATION"' VALUE. ' 

D. LOWErAnIG THE CURRENT, REGULATION VALUE TO ZERO 
. / AND HENCE CAUSING CURRENT REGULATION. 

E. INCREASING THE VOLTAGE REGULATION VALUE Dl/RING. 
CURRENT RFGULAVlON. " ' ' ' 

PLEASE TYPE THE APPROPRIATE LETTER KEY, FOLLOWED BY A CARRIAGE 
RETURN, TO GIVE YOUR ANSWER. 



f 



* 
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The student responds by pressing "D" Tollowed by "RETURN." Since the 



K 



answer the student selected was correct, the correct concept is restated. 



WHICH OF THE FOLLOWING MUST ALWAYS CHANGE THE OUTPUT VOLTAGE 
OF THE' 

A. LOWERING THE VALUE OF THE LOAD, CAUSING LESS • 
POWER TO BE USED. 

B. INCREASING THE VALUE OP THE LOAD, CAUSING MORE 
POWER TO BE USED/ ' -K 

C. INCREASING THE CURRENT REGULATION VALUE. 

D. .LOWERING THE CURRENT* REGULATION VALUE TO ZERO 
^ND^HENCE CAUSING CURRENT REGULATION.. . 

E. INCREASING THE VOLTAGE REGULATION VALUE DURFNG. 
CURRENT REGULATION. 

PLEASE TYPE THE APPROPRIATE LETTER KEY, HOLLOWED BY A CARRIAGE 
RETURN,. TO GIVE YOUR ANSWER. . x 

D. * 
" r _CORR££T. ANY ACTION CAUSING THE OUTPUT OF THE IP28 TO CHANGE 
FROM A VOLTAGE* REGULATION MODE TO A CURRENT REGULATION MODE . 
WILL CAUSE THE OUTPUT VOLTAGE TO CHANGlf. SUCH ACTIONS MAY BE 
INCREASING THE TOWER CONSUMPTION OF THE LOAD AND LOWERING THE 
CURRENT REGULATION VALUP. 

PRESS CARRIAGE RETURN TO CONTINUE. 



i 
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* \ ' 

This lecture represents the format used" for preliminary units. Other . 
preliminary, objectives may be added as the need arises. -During these 
lectures, the students' are' taught and tested in an iterative fashion 
until they are familiar with' t the material and can be advanced to the 

troubleshooting objective. % 

* > 

/ .•„■'• •• 

* 2< 8 Troubleshooting Lecture and Presentation „ , ' 

For the troubleshooting objective, the introductory material is presented 
in a similar, format, namely in short, easily understood paragraphs, which 
include an explanation of the troubleshooting task. 



r 



5 



* Tt "^s 

TROUBLESHOOTING INTRODUCTION 

YOU WILL NOW HAVE AN OPPORTUNITY TO TRY YQUR HAND AT TROUB- 
LESHOOTING THE IP-28 *P6WBR SUPPLY. THE CIRCUIT WILL BE DIS- 
PLAYED FOR YOU ON THE SCREEN, A SINGLE FAULT WILL BE PRESENT 



/SOMEWHERE IN THE CIRCUIT, ^AND THE SYMPTOMS OF THE FAULT WILL 
/BE DISPLAYED BELOW THE CIRCUIT, YOUR JOB WILL BE TO MAKE AD- 
DITIONAL TESTS UNTIL YOU CAN LOCATE THE FAULTY MODULE AND .RE- 
PLACE IT, c t 

PRJ?SS* "RETURN" TO CONTINUE. 



< 



) 
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The explanation of the task continues over several frames/ 



TWO TYPES QFj\CTIONS ARE POSSIBLE FOR DIAGNOSING THE FAULT; 
1) MEASUREMENTS AND 2) .MODULE REPLACEMENTS. EACH OF THESE 
ACTIONS WILL RESULT- IN DIFFERENT COSTS AND' DIFFERENT IN- 
* FORMATION CONCERNING THE FAULTS. THE OBJECTIVE WILL BE TO EX- 
PEND THE LEASY COSfS TO DIAGNOSE AND FIX THE FAULT. 

PRESS "RETURN' 1 TO CONTINUE. 

TO GO BACK TO THE PREVIOUS PAGE, PRESS »BV AND THEN "RETURN". 



r 



(■ 




J , 

> v 



10G 



\ 



/ 



V 



V * 



' ' " 

SELECTION OF AN ACTION WILL 'INVOLVE TWO STAPES: DE- 
TERMINATION OF FJQUR USEFUL ACTIONS THAT COULD BE MADE, AND* 
<(2) SELECTION. GIF ONE OF THE FOUR ACTIONS. AFTER TAKING THE 
ACTION, THE OUTCOME WILL BE SHOWN ON THE CIRCUIT. YOUiWILL 
CONTINUE TO LIST POSSIBLE ACTIONS AND MAKE CHOICES UNTIL THE 
FAULT IS DIAGNOSED AND TH£ BAD MODULE REPLACED. 

PRESS "RETURN" TO CONTINUE. 

TO GO BACK TO THE PhEVIOUS PAGE, PRESS ,J B'' AND THEN "RETURN", 



\ 
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> . J - 7; ' — 

it was menttdned, in your fearlier ^ession that you should 
choose actions on the ba$j"s pf three factors - uncertainty . * 
reduction, fault isolation] |and cost, the first of these, 
- uncertainty reduction, is tjle number of possible faults that 
are expected to be eliminated by this measurement* the second 
factor^ fault 'isolation is how much the action "clusters" the 
remaining faults into fewer modules, the* final factor, cost, 
represents the time and materials required by the action. 
*a Module replacement has a pigh cost* a voltage, current, 
or resistance measurement has a low cost, 

• * 
PRESS "RETURN" TO CONTINUE, . 

TO GO BACK TO THE PREVIOUS PAGE, PRESS "B* f ANDTftEN "RETURN", 



TO AID YOU IN THE LEARNING TROCESS, SEVERAL FORMS OF FEEDBACK 
ARE AVAILABLE TO YOU. IF YOU ARE UNSURE 

AS TO WHAT ACTIONS TO CONSIDER, YOU CAN HAVE f THE SYSTEM DIS- 
PLAY A SET QF POSSIBLE ACTIONS AND. THE REASONS WHY THEY ARE 
GOOD., IF YOU ARE UNCERTAIN AS TO WHAt OUTCOMES MAY OCCUR,. 
YOU CAN REQUEST A 'DISPLAY OF' THE_POSS I BLE 5 OUTCOMES . 'YOUR 
STRATEGY OF SELECTING MEASUREMENTS^ 
RECTIVE FEEDBACK GIVEN. 

PRESS "RETURN" TO BEGIN TOOU bIe SHOOT I NG . 



t ■ 



9 



10'J 



B-lb 



V 



' Fo^Q^ngy^e/^mduhiorU^h^ troubleshooting task /the System gene- 
rates a modular diagram .of a circuit and a fault table. Shown here, is 
'the- diagram 'of the IP28 p'ower supply, which consists of 10 modules, ^ . 
divided into three maj6r functional blocks % and 10 test points. Circuit 
measurements, taken at these points can be .of three types: voltage, 
current, or resistance. - Explanations of the modules, their functions,, 

' and' the type's of measurements tha-t can be made* are given to the students 

in the-form of' a handout and troubleshooting gui.de. i Durfeg the course 

of the troubleshooting objective, this guide may be (referred to or not 

« 

at the student's discretion. • 




/ 



A.C. 
INPUT 



TRANS- 
FORMER 



TP1 



COM 



/ 

TP7 



RECT. a 
FILTER 



TP3 

-1- 



CURR. 
SOURCE* 



SERIES 

RUG, 



TP4 


# 






VOLT. 
LIMITEF 



TP6 



— REF REC 
* 5 FILTER 



TP 8 



I 



REF. 


TP9 


OUTPUT 




REG, 




STAGE 




OUTP 
TP 1 
TP 2 
TP 3 
TP 4 

Trs 

TP 6 
TP 7 
/TP 8 
TP 9 
TP A 



VOL 



CUR 



RES 



REFERENCE COMMON 
TYPE "RETURN" TO CONTINUE, 
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Each* troubleshooting problem, consists "of a simple fault, which 
student must locate and correct by replacing the faulty module. The*" 
initial output symptonjs are --displayed in. the table.. . 



A.C. 
INPUT 



TRANS- 
' FORMER 



TP1 



COM 



m 



RECT. 9 
FItffeR 



TP3 



CUfrR. 
SOURCE 



SERIES 
REG. / 



TP4 



TP6 



CURR, 
SENSE 



VpLT. 
LIMITERl 



HCURR. 
UJUIEB 



TP7 



J — RF.F REC 
fj FILTER 



TP8 



REF. 


TP9 


OUTPUT 




REG. ' 




STAGE 



I 



OUTP 
TP 1 
TP 2 
TP 3 
TP 4 
TP 5 
TP 6 
TP 7 
TP 8 
TP 9 
TP A 



VOL 



CUR 



RES 



REFERENCE COMMON 

TYPE ""RETURN" TO CONTINUE*, 

lie V / 



TPS 



TPA 



OUTPUT 



I LOAD 



CdftMON 
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To begin troubleshooting/ the student is asked to select appropriate^" 
^actions. *The student ij#y "sele'dt help,' if desired, but has not chosen* 
to dor so in the present example^ r 



A.C. 
INPUT 



TRANS- 
FORMER 



TP1 

* 



T£2 



RECT. 
FILTER 



TP3 



CURR. 
SOURCE < 



SERIES 
REG. 



TP* 



TP6 



CURR. 
SEHSE 



VOLT. 
LIMITER 



LIMITER 



•TPS 



OUTPUT 
— # 



I LOAD 



TP7 
j — 



REF REC 
5FJLTER 



TP8 
■ 





TP9 










OUTPUT 
STAGE 






RDF, 
REG. 




— ''TPA 



COMMpN * 



A' 



REFERENCE COMMON ' 



OUTP 
TP 1 
TP 2 
TP 3 
,TP 4 
TP 5 
TP 6 
TP 7 
TP 8 
TP 9 
TP A 



VOL 
L 



CUR 



RES 



* YOU MUST SELECT FOUR ACTIONS WHICH WOULD SE USEFUL IN 
INDETIFYING AND/ OR REPAIRING THE FAULT » 
f • 

P^SS U "RETURN" DY T ° ENT ^ HY0UR F P UR POSSIBLE ACTIONS, 

r * 
FOR HELP ABOUT POSSIBLE ACTIONS TO TAKE "H" . THEN 
PRESS "RETURN". * ' 



•THEN 



v 



V 



When asked to select four measurements or replacements, students may. 
refer to the list of available actions in the troubleshooting guide, or 
they may type ^selections withoyt Reference to the guide.* If chptces 
• are made which are npferlegitimate actions (e.g., TP5ACVR, instead of 
> TP5DCVR),, *the choices are rejected by tye system, and new choices need 
to be typed in. In the following example, the student types in accept- 
able measurements, anck* replacements. 



A,C. 
INPUT 



TRANS- ' 
FORMCR 



C2M 



TP2 



RECT. 5 
FILTER 



CURR. 
SOURCE 



SERIES 
REG. 



TP4 



1E& 



CURR. 
SENSE 



OUTPUT 



VOLT. 
LIMITER 



<— CUPR.« 
LIMITS 



TPS 



! ! 



i 
i 



J LOAD 



TP7 



~* — REF REC 
5 FILTER 

n — 



TP8 





TP9 


OUTPUT 
STAGE 


R'ifF . 
REG. 





COMMON 



TPA 



VOL 
L 



CUR 
L 





RES 



REFERfftq? COMMON / 

TYPE FOUR MEASUREMENTS AND/ OR REPLACEMENTS BELOW. SEPARATE 
EACH CHOICE WITH A BLANK AND TYPE A CARRIAGE RETURN WHEN YOU 
ARE FINISHED'. * , « ' . 

CHOICESl TP9DCVk TP5DCCR TP4REPO TRA 
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Measurements continue to be taken in this fashion until the faulirtlas* 
been' isolated. If- the student is unsure what to do, "Help" is available 
at several points of the troubleshooting phase. In the following 
example, the studertt is again asked £o^select four actions, but this 
time,* the student responds by requeuing help. > 



TRANS* 
FORMER 



TP1 



RECT. n 
FILTER 



TP3 



CURR. 
SOURCE' 



SERIES 
REG. 



TF4 



TP6 



CURR. 
SENSE 



OUTPUT 



I— J CURR. 



4£i 



VOLT . 
LIHITER 



TPS 

0 



i LOAD 



TP? 



REF RRC 
(FILTER 



TPS 





TP9 


OUTPUT 


ROF . 




RHG. 




STAGE 



COMMON 



"TPA 



S 



REFERENCE COMMON 



OUTP 
TP 1 
TP 2 
TP 3 
TP 4 
TP S 
TP 0 
TP 7 
-TP 8 
-TP 9 
TP'A 



VOL 

L 



CUR 

. L 



RES 



YOU fcUST SELECT FOUR \CTIONS WHICH WOULD BE USETUL IN 
INDET! TV IMG AND/OR Rr PAIRING THE !*\UL7. 

IF YOU ARE READY TO F.NTFR YOUR TOUR POSSIBLE ACTIONS, 
PRESS "RETURN", 

FOR HELP ABOUT POSSLBLE ACTIONS TO TAKE "H'Vf&E* 
PPFSS "RETURN". 



THEN 



4 >* 
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Measurements continue to be taken in this fashion until the fauHrnas* 
been' isolated. If* the student is unsure what to do, "Help" is available 
at several points of the troubleshooting phase. In the following 
example, the student is again asked fb>.select four actions, but this 
time,' the student responds by requesting help. > 



V * 



TRANS- 
FORMER 



TP1 



rect. n 

FILTER! 



TP3 



CURR. 
SOURCE' 



SERIES 
REG. 



TfM 



TP6 



CURR. 
SENSE 



OUTPUT 



HCURR. 



A.C. 
NPUT 



VOLT. 
LIHITER 



TP 5 



• LOAD 



TP? 



REF RP.L 
$ FILTER 

n — 



TP8 





TP9 

*i 


OUTPUT 


ROF . 




REG, 




STAGE 



COMMON 



" TPA 



REFERENCE COMMON 



OUTP 
TP 1 
TP I 
TP 3 
TP 4 
TP 5 
TP 6 
TP ? 
-/TP 8 
TP 9 
TP'A 



VOL 

I. 



v. 



CUR 

. L 



RES 



S 



YOU 'MUST SFLECT FOUR ACTIONS tflUtH tfOULD BE USEFUL IN 
INDETl TYING AN IV OR IMPAIRING THE I* \ULT. 

IF YOU ARE R0M>Y TO ENTFR YOUR FOUR POSSIBLE ACTIONS, 
PRESS "RETURN" , 

FOR HELP ABOUT POSSIBLE ACTIONS TO TAKE "ir.fofEft 
PRESS "RETURN" . 



THEN 



v 
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The instructor's cons iderati 6ns are displayed 'in an effort to help the 
student make selections. 



A.C 



TRANS 
-FORMER 



TP1 



COM 



RECT. ft 
. FILTORI 



TPJ 



CURR. 
SOURCE 



SERIES 
REG . 



TP6 



TP4 








VOI.f. 
UMITER 



CURR. r t 
SENSf / 



OUTPUT 



CURR. 
L1HITER 



TP7 



RVS- RF.C 

^filter 



TPS 



RliF. 


TP'J 


OUTPUT 




RJ:C 




'STAGE 



TPS 



COMMON 



TPA 



I 



REFERENCE COW40N 



J LOAD 





VOL 


CUR 


RES 


OUTP 


L 


L 




TP I 








TP 2 








TP 3 








TP 4 




* 




TP S 








TP 6 








TP 7 








TP 8 








TP' 9 








i^TP A 









UNDER THESE C ! RCUMSTANCES , THE INSTRUCTOR WOULD CONSIDER JHE 
FOLLOWING TOUR ACTIONS: / 

TP9bCVR - , 

TPADCVR 
TPSDCCR' 
TP9DCCR % ' 
«* 

TO CONTINUE PRHSS "RETURN" . * 
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— 

TJ?e reasons for the instructor's choices are displayed^ 



A.C. 
INPUT 



TRANS-* 
FORME* 



TP1 



C9M 



RECT. * 
FILTERI 



TP3 

ztz 



CURR. ' 
SOURCE 



SERIES 
REG. 



TP 4 



CURR. 
SENSE 



OltTPUT 



VOLT. 
LIMITER 



CURR. 
LIMITERH 



TP7 



TP8 



PEF 


TP9 






REG. 




STAGE 



TPS 



"Tloao 



COMMON 



1 FILTER 



U TPA 





VOL 


CUR 


RES 


OUTP 


I 


L 




TP 1 








TP Z 








TP 3 








TP 4 






N 


TP 5 








TP 6 








TP 7 








TP 8 








TP 9 








TP -A 









REFERENCE COMMON 



THE INSTRUCTOR CONSIDERS THESE ACTIONS BECAUSE. OF THE 
ROWING REASONS: > 

afAULTS 
N OUTCOME PROB. ELIM, 

1) TP9pCVR L *.32 * 4/7 

N *.67« 3/7 



FOL- 



COST 
4 



2) TPADCVR ' 



L 

N 



►.32 
► .67 



4/7 
3/7 



PRESS "RETURN 1 * FOR flNAL TWO ACTIONS, 



i ■ 
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L 



1_ 



J 



TRANS 
FORMER 



TP! 



.COM 



r^ct. n 

FILTER! 



TP3 



CURR. 
SOURCE 



SERIES 
REG. 



TP6 



CURR. 
SENSE 



MCURR. 



OUTPUT 



I£2 



A.C. 
INPUT 



VOLT. 
LIMITER 



TPS . 



J LOAD 



TC7 



^-ftEF ROC 
^FILTER 
\ 1 



TPB 



I 





TP 9 








COMMON 


REF. 
REG. 


OUTPUT 
STAGE 












L TPA 





OUTP 
TP t 
TP 2 
TP 3 
TP, 4 
TP S 
TP 6 
TP 7 
■DP 8 
"IT 9 
TP °A 



VOL 


CUR 


RES 


L 


\l 








N 




1 





J 



' REFERENCE COMMON 

v. 

HERE ARE THE LAST TWO ACTIONS CONSIDERED BY THE EXPERT: 



ACTION 
3) TPSDCCR 



4) TP9DCCR 



OUTCOME 
U 
N 
W 
L 
H 



PROB. 
♦ .67 
G 

♦.32 . 

♦.32 

♦,67 



FAULTS 
ELIM, 
3/7 
0/7 
4/7 
4/7 
3/7 



COST 



•PRESS "RET4JRN" TO CONTINUE. 
H 




.Further help can be obtained at this point, which* would pi^oyida a list 
ef the four actions, ranked in terms<;of their multi-attribute utilities. 
If help 4s^ not selected, the program requests the student fco list four 
considerations, which need not be the same as those of the 'expert* and 
then select one of .them for implementation. After having -taken .several 
measurements, the student is adain asked to select four possible actions. 



A.C. 
INPUT 



TRANS- 
FORMER 



TP1 



COM 



T£2 



RECT. Q 
FILTER! 



TP3 



CURR. 
SOURCE 



SERIES 
RCG. 



TP6 



CURR. 
SENSE 



OUTPUT 



VOliT . 
MM ITER 



CURB. 



LIHITER— J 



TPS 



"Tload 



TP7 



KEF REC 
1 FILTER 



TP8 



-RF.F. 


iTPO 


OUTPUT 




REG. , 




STAGE * 



.COMMON 



-r* 



•TPA 



REFERENCE COMMON 



OUTP 
TP - I 
TP 2 
TP J 
TP 4 
TP 5 
TP 6 
TP 7 
TP 8 
TP 9 
TP A 



VOI, 

L 
L 



CUR 
L 



RES /ypE - FOUR MEASURER 
— /EACH CHOICE If J Til AVE 

V ARE finished; 



NTS AND/OR REPLACEMENTS*BELOH. SEPARATE 
BLANK AND TYPE A CARRIAGE RETURN WHEN YOU 



CHOICES ! JP9PCVR TP5DCCR TP4REPO TRA 



\ 
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The student is aslced-to -selectman' action, using, the listed attribute 
levels as a guide. The student selects replacement of the -faulty .module 
by typing "TRA" followed by "RETURN. " , . . """ 



A.C. 
INPUT 



TRANS 
.FORMER 



TIM 



IE! 



rect. n 

FILTER! 



TPS 

-t: 



CURR . 

sotmcn 



SBR ICS 
RRG. 



TIM 



TP6 



CURR. 
SENSE 



OUTPUT 



VOLT. 
MHtTGR 



Hewn. 

LIHITER 



TPS 



TP 7 



rrf RBC 
IFM.TBR 



TP 8 



RHP. 




OUTPUT 




REG, 




STAGE 



COMMON 



TPA 



REFERENCE COMMON 



oirrp 


TP 


I 


TP 


2 


TP 


3 


TP 


4 


TP 


S 


TP 


6 


TP 


7 


TP 


8 


TP 


9 


TP 


A 



VOI, 

L 
L 



CUR 
L 



RES 



tilIfS,JS L ?S^ RE ™ E FOf,R INSIDE RED ACTIONS AND THEIR 
ATTRIBUTE LRVf.LS. 




ACTION 

1. TP9DCVR 

2. TPSDCCR 

3. TP4RHPO 

4. TRA 



DECREASE IN # 
UNCERTAINTY 

♦ .40 
<4X) 



V.>1 
ITS 



FAULT 
ISOLATION 

^33 
♦.33 
♦.43 
♦ .19 

4 



COST 

♦4.00 
» +8.00 
♦10.00 
"♦98.00 



TO^SELECT AN ACTION, TYPE ITS NAME, THEN PRESS "RETURN." 
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Thfe module is enhanced on. the display to indicate* that it has blen replaced. 
If the replaced module correctly 'repairs the circuit, the output measure- 
ments in the fault table will t>e changed from low readings, to normal i 
r&adijoqs, as indicated below. The student also will be given feedback 
*o the -effect that the circui't hai been repaired, and the student's cost 

involved in troubleshooting the circuit will be. Compared. to that of the 

.* - . / ' - - « * " 

instructor. . ' . * < - ~ s . x 



, r 




FlLTEPl 



TP3 



SERIES 
REG. « 



TP6 



CURR. 
SENSE 



OUTPUT 



SOURCE 



TP 4 



A.C 

INPJUT 



Si:!: 



VOLT. 
LIMITED 



CURfl. 
L1M1TERM 



■TPS 



"Tload 



TP7 



REF J^KC 
TILTER 





TP9 


OUTPUT 


REG. v 




STAGE 



COMMON 



-TPA 



REFERENCE COMMON 



OUTP 
TP 1 
TP 2 
TP f 
TP * 
TP *' 
TP 6 
TP 7 
TP 8 
TP 9 
TP^ 



VOL 


CUR 


RES 








L 




/ 


L 










*N 


H 







CONGRATULATIONS ON REPAIRING THE CIRCUIT. YOUR TOTAL 
TO DEBUG THE CIRCUIT WAS * 120. , 

THE INSTRUCTOR'S TOTAL COST WOULI^HAVE BEEN +120. 

PRES3 ''RETURN" TO CONTINUE. ' ^ 



COST 
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Comments are displayed to the °studen£ stressing considerations'^ improve 
performance. , • ... 



v., 



\ 



INPUT 



WW'.:''. 



TP I 



IE1 



R6CT. 8, 
Fl LT£R 



TP3 



CUpR. 

source 



SERIES 
REG. 



TP4 



TP6 



CURR. 
SENSE 



OUTPUT 



VOLT. 
IflMTBR 



M CURR. 

LIMiTER-J 



TP5^ 



I 

i 
i 
i 

* i 

"Tload 



TP7 



■ hep &nc 

1FILTER 



>TP8 





TPD 


REP. 




REG. ' 




1 



OUTPUT 
STAGE 



X 



common 





VOL 


OUTP 


N 


TP 1 


L 


TP 2 




TP 3 


L 


TP 4« 




.TP S 




TP 6 




TP J 




TP 8 




TP 9 


N 


TP A 









CUR 
N 



RES 



REFERENCE COWON 

YOUR CHOICES INDICATE THAT YOU A r\ INCONSISTENT IN YOUR 
T R 9"^ESHOOTING STRATEGY. BEFORE JfAKING A CHOICE, CONSIDER 
J: FULLY THE-JJNCERTAINTY REDUCTION, fiKULT I SOL AT I ON , AN D • 
EQ 'ASSOCIATED WITH ^ EACH CHOICE. 

'PRESS "RETURN" TO CONTINUE. 
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Display of comments to the student continues. The student wi<H now begin 
another troubleshooting problem. 



A.C. 
INPUT 



»*.v 



TPl 



CJM 



RBCT. ft 
FILTER 



TP3 



CURR. 
SOURCE 



ERUIS 
REG. ~ 



TP* 



TP6 



ctmR. 

SENSE 



OUTPUT . 



VOI,T. 
LltftTER 



CURR. 
LIMITERH 



TP7 



KEF REC 
J FILTER 



TP8 





TP9 


f 


REF. 




OUTPUT 


REG. 




STAGE 





VOL 


'OUTP 


N 


TP 1 




TP 2 


N 


TP 3 


L 


TP 4' 




TP 5 




TP 6 




TP 7 




TP 8 




TP 9 


N 


TP A 





CUR 
N 



RES 



•TP 5 



! ! 



i ! 

Tload 



COMMON 



•tpa 



REFERENCE COWON 



YOU APPEARED TO OVEREMPHASIZE: 

l/NCERTAINTY REDUCTION § FAULT ISOLATION 

f 

AND UNDEREMPHASUE; % / *\ 
COST 

PRESS "RETURN" *TO CONTINUE, * • , 
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At the conclusion of each problem, the student's performance data are 
printed out orua teletype and a new problem is presented until the 
session ends, wether as a result of completing a certain number of 
problems, or because the student has become' an expert troubleshooter. 
An example of an actual print-out for the first two problems of a 
session is shown in Table 2-3. \ & • 

\ 



ERIC 



B-34 



125 



FIGURE T * 
ACTS 79 TROUBLESHOOTING OBJECTIVE 

c 



• PERFORMANCE REPORT (CURRENT FAULT) 
STUDENT': ^ » - AGE: DATE: 

CIRCUIT: 1 ' FAULT: ^1 

HELP AVAILABLE: YES 1 1 FEEDBACK AVAILABLE: YES 
STUDENT INPUT ' SEQUENCE : ACTION-OUTCOMES 
TP5DCVR L 
. *TP4REP0 : ; N 

tifeftVR ' • ' l. 

- TP1ACVR • * > L 

* TRA * F 
STUDENT WEIGHTS: +.45 ^ .+.88 

EXPERT WEIGHTS: - +.70 . +.70 
CONVERGENCE ACHIEVED: NO 
UTILITY RATIOS:' STUDENT: +5.76 
UTILITY DIFFERENCES* +.25 -.18 -.08 

SLIDING WINDOW-PERFORMANCE: * 

' TRAINING?: 1/20 TOTAL ADJUSTMENT: 
SIMU. SUBJ. DRIVING WEIGHTS: " +1.00 +1.00 +1.00 

PROBLEM C0ST:+O.1240E+03 * 
TOTAL C0ST: % +0.1240E+03 

ACTS 79 TROUBLESHOOTING OBJECTIVE 



+ .07 . 
0 

CLOSE TO EXPERT: 
+11.32 



NO 



PERFORMANCE REPORT (CURRENT FAULT) 
AGE: DATE: 
2 

FEEDBACK AVAILABLE: YES 
5 , ACTION-OUTCOMES 

. N 



FAULT: 



STUDENT: . - 
CIRCUIT: 1 .• 
HEjL-P AVAILABLE: YES 
STUDENT INPUT SEQUENCE: 
TP9DCVR 

TP3ACVR ' . 

TP1ACVR*- . 
STUDENT WEIGHTS: +.45 
EXPERT* WEIGHTS ■ +.70 
CONVERGENCE AGHIEVED: NO 
UTILITY RATIOS': • 'STUDENT: 
UTILITY DIFFERENCES: +.25 
0 OW PERFORMANCE: ' 
TRAININGS: 1/20 TOTAL ADJUSTMENT: 
SIMU. SUBJ. DRIVHiG WEIGHTS: +1.00 
PROBLEM COST:'. +82.00 \ 
TOTAL COST: +82.00 



L 
N 



+.89 -,02 
» +.70 <3- 

CLOSE TO EXPERT: 
19.22 -37.74 



NO 



-.18 



.+:oi.* 



+1.00 



+1.00 



y 
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DISTRIBUTION 



l US AKMy tlNC^At bjHPUHf OHUUH HtRbONMLL l»IViS»N 
i MtJ )A AJJNJ PM A C ' ? 

4 TA?»/I AtiCEN ATI : bAAb-tU ' 
* HU* JCaTA, AITNI -AlCAl-JH-u 

d h^»A ufcbEARCH aRO SlUUlEb Oh C ' ' f 

i Mil.lfAwY UrCUHArrjN/VL.UtVCCU^HMMl UIV U HC-MSP-U f .HM gS^C HOFFMAN HL,b I f 

** OA>0 CmHA ANU L) > ' 

i HlJ ICAJA Ttt«N|LAC LlUHMHf 
i« H(4 )A CHIEF, 4 HU MM HLbOUKttS Ot VtLORMtNT hi)/ , . # 

1 USA AvT^fT^^^Mb^COMU AHNJ xUHSAV-Z W 

* i I IS a COPfcOCOM Af TniV^AH^L-KA-Rh N T 

i HF*\OUUA$JtRS Ub MAR I Nt CUR^SjL aJIN: LJUt MlMT 
i HF.-UUJU&eTtwb* Os viawINl' CukPX a! IN: Cud* mP1-46 
<> US* AKMy \tOROPfc ANJ btVtwIH #HMY 

i 1 S f iNh^J^Y-H^hH^lil^ AtfD FTV viLtY AfH«; AaF<JN-OPT-T 
i CHlFF, bUKVEY O^AMCH^AI Ii^: WAPL-MbF -;>t nOFFMAN *LOb IT 
I IIS- IN f LLL I Ut Ntt .AiMU^ttO^iTfY c^NMANll ATTN! lAOPS-TNfc % 
t THAoOC T tCHi « I C All LImKmR* 

i NAv/AL TRAINING HJJiPMtNI LtKl 1 A I IN: TECHNICAL LIBRARY 
- I MflllMWY OCCUPAllDMAL ucVtLOPMeNl Ulv AfTNt UAPC-MSP-St Hh2C "OF F MAN *L >b I 

1 Mf| ITAWY* OCCUPA1 IJNAL UrVtLOPMKNl Ulv ATTN* UAPL-MbP-D, MM 8b<>C, -Oh F MAN HLlKi 1 
t 1 Mll'lTAPY OCCUPA? I'JNAL UfcVLLOPMFM UlV ATTN? UAPC-MSP-T, «M Hb/fC f mOFFM^N HL1»0 I 

i AT h INkANTpY UlvlSiO^ . j 

I HQ )A *tAim* FURt-b MANAbtMLNT Of- ^ 
-I HU )A ATTN: OAb«,--MH . » 

J 12U> USARCOM R* b£RVt LtNUR i * 

1 FT. HEmJAMTN HA^RlSONf IN 4t><f | O — * 

I lib* fOwCtb, COMMAND AFLu -UtHljlT LnltF i>F *bT AFT ^H-UlorbT ICb \ * ♦ 

I tib ARMy AlR HEFtNSt- * . ^ ^ - / | 

I ol yfcC!'>HAH Oh IRalNlNb AlTN: aIZU-T 

| OI^FCTmRaTE OF CUMiimI ot VtLOPMf- Nib aUU; ATZA-0 # , ^ ' 

| MiJOARCoM MANINr CuRPb Ll*LSUN. OFL 

I tffcPA«MENT OF iMt nWMY ARMY m*ELuli,FNCE ♦ StCURlTY COmMANU 

' i hq >a rnitF, Rtri^Lu AU iviT its 

1 i)J>\ MiSblLF MAlrRItL^RLAUlNEbS COMMANJ A I IN; URS>Mi-NTK* 
I ARTAOb AlTN: U^L=>M-*TUb-Tv 
I US'* FO*Ctb COMM,\NJ 
| pm TRAot / 

1 US MlLlTuRY Ui^l»VfCT Uh ^«bNlN^lON OfC OF tuUAL OPPOPTUNiTY 

I iNAVAL rlVlLlA-N -h-fbpNNLL tOMU SOUTHERN ^LD,UlV 
?u AH { LiAlbOl^ OFh )Ci . # _ 
'l TTM AR-iY TRAlNi »u ClNTlR 

I a r tY TRAINING ^mP=>OR'I ClWIlR TNUlViuJAL TRAINiNb tVAiJlATlON 

I HO')At OCbOPS iH'IvlOUAL I " A IN I Nb 

1 hQOA# DCbOPb I^ATNlNb UlRt.CTO^ATt 

I HQOAt OCbLOH. ^AiNTENANLt MANA ;tMttff 

I HO>A« >CS S tUUf/JFF ICE ' • 

I Ub.iCOEr ATTN: nuMAN aL I OR b f 

1 SATRAMFNIO ALC/«>PChH 
' I USlFAbob/TAC ^«-Nh)R AR.»Y AOViSUR 

i rNTtH-UlHiV SLMlNA-J UN AHMtU* FOPTCtS ♦ iUQ 
-I uAsA (^OA) UERuTY FU K ^tiENCE aNU TECHNOLOGY 

i oFx of- naval Rt b tARCH V - * 

I AFhRL/l Rl ; 
i AFHR.L/I RL . 
1 AH FORCE HUMAN Hi^OURCtb LAb. mMN; AFhRL/jbR 

1 Hbh) AmRL/RH - * 

.LNAvY.PF'KSONNIrL h AND 0 CENJER^ UiMECTOR OF PROGRAMb 

1 ^AVY Pf PbONNEL •< AND U CENTfcR* / * 
OP f OF NAVAL Rt st ARCH RtRbONNF U ANU I R A I MlNto R£bE ARCH PRObRAMb 
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OK: GF -NAVAL Rt->tAHCH Abb I* UtHtUOR PEPS ♦ TRAINING RSCW PRObS i 

OFc Oh NAVAL Rt^tAKCH HKUJECT uhUCLKt F NV IRUfvlMtNT AL PHYS I ULOoY ' 

NA/AL AfcHUSPACt* ^H£ulCAL RbLH LA« *A1 TM# (CQUt LSI) 

NA/AL At^USfAtt M=uICAL RbLH LAO A \ RcWRmE "HANGER RESFARCh 

HiwKtU Uh f AVAL PE^bUNutL. bClFNllMC &Uv I SOR (PbRb-OR) 

MA AL *.\tKOSPACt rttl'ICAL KbLH L At> 'AEhJSPACE PbYCHOLOGjf DtPARlMENi 

us.» TRaUuC bTbi*«b ANAtfbib AtllVlfY ATTM: A A- T CA 

AOi«UAKlk^« L rtSf gUahU Chii-ht PSy£*U)| ulil^L «SCH up 
,iS \« research aw** TtcnNULUor l ah a I T iy: OA Vl)L-Ab , 

HV. MOPIL11Y ttf-ll-MENT k aNU.U LUMU flip,: UkUHE-T^ " * / 

hi ;hT vlblON l» * aHn: UHbfcLr ,,v "^ u O * - 

ilb» IRaInIMp dO\kj 

U^A ^ATtKl-FL bt^FiMb ANALYjib jtllVlTY <\TTN: URXb-YrM { ^ 

MAFfcC HUMAN LNm I Nt t K iHU OKANCri 

HalltLl't-CrtLUMo »b i ArtUHAlUMltb fACTiCAL 1EChn*ICAl Vt C 
ARrUC ft-bi LiN AlIN: AMblL-PL-Ts 

AH(11C lr;bi i : u aMn: blEAL-PL-ni J * 

DEKENbf LANGI»AOr 1 i\S ! 1 UJ 1 1. t-UtttlOh L A Nt,nAbE CEN 
hU wHATP DlV ^HJKUKbYClilATJH 

US** tLfCfWONlC *A«vr ARt Lad Chltft iNltLI IbENCE MaTEn OF.VtL ♦ SUPP ()K" 
US* PSf* UFVtL ♦ blANU«HUl/A OP? U»K. 
."AFFDL/F bK (CU1L) 

USA NATlLN h?I-SL HCh mNu ULvtLUPMLNl £jMM/nU CHltFt HFHAV SCIENCES UlVt FUUU SC I LaH 

OAiDt^ AND t I ► A imu Lb) MILITARY Ab^l h OR TNG ♦ PLUS TEtHNOL 

h J"A ' „ . 

NAV/AL SYMt.O LOMMANU A!Tn: AIK-dJJ*^ , 

U^> CUtrtL. f**C« IC^L LIHHakY 1 

llSAAHL LibPAHf 

H(J AN r^tbOuWC tb WSCm Oku CnUMRpU) L I A^Y 

SEVILLE Kt SE AKCm CuKHOkaUON f 
Obi TH^UOL SYbli-MS ANAL'Ybib AC f i V 1 1 Y ATTN; AlAA-SL (TFCH LIBRARY) 
UNUUKmEu SE^Vi'tS UNll U* THb riLAL 1 H bcf UlHAMTmENT OF PSYCMIATHy 
MU^iaN HEbUI.K'Ct^ wStH UHi, CnUMHWU) 
HU^PHU WtblfehM LlHPAHT 
HATTtLlt PE^OKlb tlnHAKY 
^PA if) CoHPUPAlIUi «JJN; LibHAHY U 
hH )N I NnLK Ll^^A-Y AflN; A I & -pb-L ! 3 U 

C£ iftH -FOM NAvAi AN AL Yb i b 
h A v AL HLALIH H (tw L IokAH Y 

NAVAL PtKbONNtL w A NU U LtN L 1 H K AKY ^ A 1 : CUUt ^20lL 
A I ^ fOPCt, HUMAN HE^UUHCtb L Ad aI Tn': Af-M^L/Ol 

Fl # HUA^MUL » r r M : T tXH Hl-h UiV . % 
Ub*V ^CAUEMY t)F iLALTH SLiL'*Ctb sliMSJN I IHHaHY -( I >OCUMFN T b ) * 
SC.ii')UL Ut- SYSft-b LOOib.TlLS A f f n 2 ? Al- I T/LbCM 

FrtfC PPUCtSSlNU AMU ^tttKLNCE FAt* ACQUIS ITlUNb L 1 bHAP 1 AN 
h£PAHlMt/>n M 1'^ *-avY ( fKMlNiNO ANALTbls ANU EVALUATION bp 

NAHONaL CEMIbH K")>^HEALlH SlAlibllCb J „ . 

US iA hEH! Of- bHM^V*lUHAL bLl Ar^U LhAUtHS^lP 
US NAVY CNtf biipi>Okf HcbtAKCH LijiHApY 

OLO UUMlNlON UNIVEHS1TY PLHhUPMMNCE Abbf-SSMENT LArtOMATOHY 
\\%A COmMANO ANU b£NEPAL b(Mf-h (.uLLEoE ATTN: LW^AKY 
US/^ TPANbPOPf A? !ON bCHUUL UbA IXANbH T^r h INFO 4NU PSCH C^N 
NMHUC PROGRAM ^AMAbEH h UH HUHa^ HtRh JHM aNCE 
USA AU^1NCPN\ IrC-iNlCAL Ht bE^Rf H t bK ANCfl \ iHKAHY 
UbA FlrLU APIY — OJ A 



i a Fin 

t*A T CLhAR iNGHOUst FUR MLNCaL hf-MLlh HFU PARKLA^N HLOfi 
yL )F ^>^Ab CEN Fjh CUMMUNiCAT |UN RSC^ 

INiTlTnft K)R U^ENSt ANALYSES' 5 . ,v 

USa fRAlNiNG bUMpJhf CENtth UfVtL SySI^mS TNG ♦ UEVlcFS UIKECTORATjE ^ 
nHWL TLCHNOLObi JF C (H) » ' , 

PUmUt,UNlv DtMl UF PbYLHULU'blLAL SCitNOS . * * 

US » MOm 1L 1 T Y tWii^MtNT R A.NU U CUMMANJ - r.TTNj URUME-Zfi , t 
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Al fN: SC«UO# LibRARY ! 
UtHT UF feRMJNO SENSORS 



SVCS OJ-F IChP 



f-uUCAT PNAL 

ClilLf* ult3tfA)UAN 
A ISA-UI 



ilS A 
USa 

us.a 



us \ 
us * 
us \ 

USA 



L* ARNT NO KESUURCEb CtNTtK 
AUVlSON 



OA US ARMY RtiKalNlNO Hut - ■ RtSF AKCH ♦'tttALUATlUN l)IR 
HU~«AN ^tSUlRCt lANAOtHt it. LtN # SAN Ultou' 
IIS\FA DtHI UF Ll p t ANU bth SC I { / 

MS MlLlTAHY ACAi'liHI LltfRARY 
US* INrt-LUTGfcNCr CtN ANu SCH 
US > iMLLLlbhNC^ CtN ANJ SCH 
MA^lNt CUH^S' Ins! 1 TU1E 
NAn/AL SAHtTY CtAwl£H / 
US COAST 'OUAHU ING CLN aMNJ 
*US*AVNc ANH FT. RJCKtK ANN: 
US ARM/ AVN T NO LIBRARY A 1 T N 1 
USA Aiw OfcFtNSt SCmOUL , A I I N : 
USAAVNC A1TNS ZU-U 

1 1 S MILtURy ACAi)tXT UlxtV-TUR OF 1 NS 1 i T , J M ()NAL RSCH 
uSAAUbwklbkAHY- UCUMtNlb " 

• USa StRGFAN?S MAJUk AuADtMY AITnJ 
INFANTRY dUaR} AT In: ATZh-lb-T S-H " 
lNTtLLIGFNC CFN ANu SCH hUUCATJUNAi 
ORHNANCt Ct- AND SCrt mTTN; Al SL- 1 tM-C ~ 

AKmOH SCHOOL ATIN; Albb-UT^IR ^ 
AR'«UK f.F.Mt»/ UlKECTUKATt *)F CUMh A f Mfc vtLyPMtNTS 
NAv/AL >ObTNRA()U vT t SCH AlfN: UUULtY *Nox L IbRARY (CODE 1*?*> 
USA fRANb^OH! Al iU\< SCHUUL UtRuiY AbS»» fOMMANDANT EOUCA* TtCHNOLU 
bliiNAL SCHOOL ANU M. bOKUoN ATTN: ATZH-tTt 
gUARrt^^SltK SCH AT \h\ ATSm-UT- Tm-i- t 
Mij IfApY MUi ICt SOuoL ATTN S* LlMAn Y 
Ah^UW SChCFOi tvAL *K*NC«t UiRtCTJrtATI- 
C/HIFF nF NAVA|_ 1 ujCATlUN AnD Tno / 
US '.bibs - ST AM- *n ii ) f-'ACUtTt UtV ANU In^ l> I V 
Mg ATC/XpTh [Hii^l^u SfbltMS OtVtLOH^tNT 
USA iNsTlUTt F.»h N.ILIUHY ASSfSJANCh -ATTN* AISU-TU- 
US ARMY ARMOR Si hDol UlRtCTUkAlt UF TkainINO* 
USA Alu Ubf-tNSt SCHOOL aIIN: ftl^C-UM 

\)S\ UUANJtWMASI u * SCHUUL U I Rfc,f 1 UHAT t UF TRAINING UtVELOPMENTS 
« IS CUAST Oi AKU ALAUtMY hHn: CMUtT CJUNS*- LOR (i)iCK SL TMAH) 
US*k IRaNSRORTaUuvj SCHOOL UlRKClUK OF TpaINING 
USA iNf-ANTMY SCriUDl LibKAKY / ' 
US A INFANTRY SCmUJL ' ATINS AlSH^irV 
US AKMf I NF AN 1 h r SCHOOL ** I J N • aTSH-CJ 



U> INSTRUCTION 



' T A 



US \ 
US i 

US A 

US \ 

US A 

l^ 

us * 

NYh 
USt 

us^ 

USA 



iNMNlwr SC^UJu ' A I 1 N : AISh-UOT 

INp ANTp r SCmJJl AMns ATSh-cV 

Hit ITAPY POrlCI- SChOUL/TRaIhING ClNIi-W 

MIi ITa^y POi ICt sCmuUu/ TkAlNiNO clNTm< 

MlilfAkY ROLiCL SCHOOU/ THA I^INO CcWTh^ 

Mlll^A^y ROciCh bCnoUL/TRATNlNO C^UR 



in^tjSlth O^ 

LlwRARY 

F ULU APT ILLt^Y bCHUOL MUPR IS" Swt T T 
INsUUTfc Oi- AhMlNlblHATiOK. ACAULMir 
wA ' CUlLtbt ATTN:' L Ibr* AN Y 
US^ feNGlNtFR SLm03 L lHRAKY A^U 
USa ARmOR SC-0O l JOSARMS) ATTn'* 
US C^ASf blA*U ACAUfcMY LibRARY 
USA TRANSPORT AllONi SCHUUL. TRANSPORT A I I 0* 



AlTN: ATZN-PTS. 
UIR* CUMbAT UtVtLORMENl 
UlR» TRAINING OEVtLORMhNT 
ATTN: ATZN-ACt 



AUMlNlblKATi^g A1TN: RhSlUhNT IRAINIMG MANAbEMt NT 



I IbRARY 
LibRARY 

hLSUUhCES t CFMTER 



LbAwNiN'- 
LlBRARf 



SCHUO^ LlbKARY 



OR m ANI / AT ION A L \t f tCT 1 VtNfcSS Tr ^ U Cfc.N S . f t ATTN* LlB R ARlA K 



US ARMy lNTtLL*«tfcNCt CtNTtK ♦ SLHUOL 
US ARMy INTELLl^tXCt CLdtK ♦ SLHUUL 
US ARMy iNTFLLl'-LXCE.CLNfth '♦-SLHUUL 
US MAW t tyE CORRb EUUCATiUN CtN T LK" 
US\ FihLU ART ILi t*«Y SCMOUL UI^tLlURATt 
BRITISH HlMHASSY ^hUISfl utFtNCC S t AF f 
CA lAUlAN JOINT "si AFF 

1X3 



attn: 

Af TNS 



ATSI-IU 
ATSI-WM-M 
ATSI-OT-SF- 



IH 



OF CuURSt UEV ♦ TRAINING 
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1 CDLS U> LlHMAKv * , 

1 FRENCH MILITARY A J I ACHE " , 

1 AU>TH 1 AN tMBASbr MlLIUKY ANU Aik AT TAChE 

J CA>iA0l5N UtFENCf LIAISON S> 1 Al- F aIIN: COUNSELLOR* UEFFNCf R ANO 0 

I ROYAL KclrifrWLANi.b f-MttAbbY MiLlUKY A f T ACHE 

t CA iADUn FOPCEb CORNwmLUS ATTN: PERSONNEL SELECTION 

k CA AUI an KikCtb P=HStfNNtL : «PHL HbCH UNl f 

1 AH if PFkbONNfcL "ESfcAKCn E^^LIbnMENT n 

i Ai? <Y PERSONNEL HbbhAHCn I AbL I bhAtN T n^I SCltNflKIC lNA F I ON c^MCt- 

0 I.I-iRARv OF COn^kLSS EACH^NGfc ANU bIF f UJv 

1 M^ENbF IbCHNlUU iNhOKrt^riON CtN A T I N; . DT It-CC ^ 
IS J LlHMAHy Oh* CONFESS UNIT UOCUMfcNIS fc XPbJ ITlNu PKoJtCT 

I HMlOP, K AND u MAUAZlNt a TI N iJuHLOt -Ln 

1 US GOVPHNMI-NT PulVTINb Oh L Llt*ttAK*« ^U^lIC DOCUMENTS nEPArtfMtNT 

I H* i.OVhHNMtNl Pwi\|HNb *t\< LImKAKY a>U) ^TaTuTORY, LIh OiV (SLL) 

1 Trt- AH MY LiHKAHf 

J / / . 
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